Oct 30 18:35:07.176324 ip-10-0-133-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 18:35:07.176333 ip-10-0-133-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 18:35:07.176340 ip-10-0-133-244 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 18:35:07.176560 ip-10-0-133-244 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 18:35:17.184247 ip-10-0-133-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 18:35:17.184265 ip-10-0-133-244 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 80b67a1ae7184f64b8da9ce035fca3c1 --
Oct 30 18:37:17.720485 ip-10-0-133-244 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 18:37:18.158451 ip-10-0-133-244 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:37:18.158451 ip-10-0-133-244 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 18:37:18.158451 ip-10-0-133-244 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:37:18.158451 ip-10-0-133-244 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:37:18.161837 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161766    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.161837 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161836    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.161837 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161840    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161843    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161846    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161849    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161852    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161855    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161858    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161861    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161863    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161866    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161869    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161871    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161874    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161876    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161879    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161882    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161884    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161887    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161889    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161892    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.161926 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161894    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161897    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161899    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161902    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161905    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161913    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161916    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161918    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161921    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161923    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161926    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161929    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161931    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161934    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161937    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161940    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161943    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161945    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161948    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.162398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161950    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161953    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161955    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161958    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161960    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161963    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161965    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161968    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161970    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161973    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161975    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161978    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161981    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161983    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161986    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161989    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161992    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161995    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.161997    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162000    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.162834 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162003    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162005    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162008    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162010    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162013    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162015    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162018    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162021    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162023    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162026    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162031    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162035    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162038    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162042    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162045    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162048    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162050    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162054    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.163332 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162058    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162062    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162065    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162068    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162071    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162073    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162076    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162079    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162081    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162085    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162087    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162090    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162093    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162095    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162098    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162100    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162103    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162106    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162109    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162112    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.163764 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162115    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162118    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162120    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162122    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162125    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162127    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162131    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162919    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162926    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162929    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162932    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162935    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162939    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162941    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162944    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162947    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162950    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162952    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162955    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162958    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.164289 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162960    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162963    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162966    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162970    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162975    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162978    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162980    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162983    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162985    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162988    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162990    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162993    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162995    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.162999    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163003    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163006    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163009    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163011    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163015    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.164784 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163018    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163020    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163023    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163026    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163028    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163031    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163035    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163037    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163040    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163043    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163046    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163048    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163050    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163053    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163056    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163062    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163065    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163068    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163070    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163073    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.165248 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163075    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163078    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163080    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163083    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163085    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163088    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163091    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163093    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163096    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163098    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163101    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163104    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163106    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163109    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163112    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163115    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163117    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163120    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163123    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.165726 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163126    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163128    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163131    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163134    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163137    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163139    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163142    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163144    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163147    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163149    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163152    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163154    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163157    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163159    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163162    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163164    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163167    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163169    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163172    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.166174 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163174    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163176    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163179    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163182    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163185    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163187    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163190    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163193    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163197    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163199    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163202    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163204    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163207    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163210    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163243    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163248    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163731    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163737    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163741    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163744    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.166637 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163747    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163751    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163754    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163757    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163760    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163762    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163765    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163768    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163771    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163774    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163776    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163779    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163782    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163785    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163787    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163790    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163793    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163796    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163799    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.167107 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163802    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163804    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163807    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163809    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163812    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163814    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163817    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163820    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163822    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163825    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163827    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163830    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163833    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163835    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163838    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163840    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163843    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163846    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163848    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.167565 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163851    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163854    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163856    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163859    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163861    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163864    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163866    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163869    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163871    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163874    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163877    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163880    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163882    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163885    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163888    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163890    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163893    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163895    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163899    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.168005 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163903    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163906    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163909    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163911    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163914    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163916    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163919    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163921    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163924    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163926    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163929    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163931    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163934    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163936    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163939    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163942    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163945    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163947    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163950    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163953    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.168559 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163956    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163958    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163961    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163963    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163966    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163969    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163971    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163974    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163976    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163979    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163981    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163984    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163986    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163989    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163991    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163995    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.163997    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164000    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164002    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164005    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.169055 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164007    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164010    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164012    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164015    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.164017    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165052    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165063    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165071    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165076    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165080    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165084    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165088    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165092    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165096    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165099    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165102    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165106    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165109    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165112    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165115    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165118    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165121    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165124    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 18:37:18.169539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165128    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165131    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165134    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165137    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165140    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165146    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165149    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165152    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165155    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165158    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165161    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165164    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165168    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165171    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165175    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165181    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165184    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165186    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165189    2577 flags.go:64] FLAG: --enable-server="true"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165192    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165197    2577 flags.go:64] FLAG: --event-burst="100"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165200    2577 flags.go:64] FLAG: --event-qps="50"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165204    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165207    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 18:37:18.170073 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165210    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165217    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165220    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165234    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165237    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165240    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165243    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165247    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165250    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165253    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165256    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165259    2577 flags.go:64] FLAG: --feature-gates=""
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165263    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165266    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165270    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165273    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165276    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165280    2577 flags.go:64] FLAG: --help="false"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165283    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165286    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165289    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165292    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165295    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 18:37:18.170657 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165300    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165303    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165306    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165309    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165312    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165315    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165319    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165322    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165325    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165328    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165333    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165336    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165338    2577 flags.go:64] FLAG: --lock-file=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165341    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165344    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165347    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165353    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165355    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165358    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165361    2577 flags.go:64] FLAG: --logging-format="text"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165364    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165368    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165370    2577 flags.go:64] FLAG: --manifest-url=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165373    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165385    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 18:37:18.171207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165388    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165392    2577 flags.go:64] FLAG: --max-pods="110"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165395    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165399    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165401    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165404    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165407    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165412    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165415    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165422    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165425    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165428    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165431    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165434    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165437    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165440    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165443    2577 flags.go:64] FLAG: --port="10250"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165448    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165451    2577 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0e23fb8696a011ef5"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165454    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165457    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165460    2577 flags.go:64] FLAG: --register-node="true"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165463    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165467    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165470    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165473    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 18:37:18.171836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165476    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165480    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165483    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165486    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165489    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165492    2577 flags.go:64] FLAG: --runonce="false"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165501    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165504    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165507    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165510    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165513    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165516    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165519    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165524    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165527    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165530    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165533    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165536    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165539    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165542    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165545    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165550    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165553    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165557    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165561    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 30 18:37:18.172503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165564    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165567    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165570    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165573    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165576    2577 flags.go:64] FLAG: --v="2"
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165580    2577 flags.go:64] FLAG: --version="false"
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165585    2577 flags.go:64] FLAG: --vmodule=""
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165589    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.165592    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165732    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165736    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165739    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165742    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165744    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165748    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165750    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165753    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165755    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165759    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165762    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165767    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.173121 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165770    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165773    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165777    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165779    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165782    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165785    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165788    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165791    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165793    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165797    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165800    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165803    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165805    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165808    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165811    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165813    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165816    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165818    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165821    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165823    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.173625 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165826    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165829    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165831    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165834    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165837    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165839    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165842    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165845    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165848    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165850    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165853    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165855    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165858    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165860    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165863    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165865    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165868    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165871    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165873    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165876    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.174102 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165878    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165882    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165885    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165887    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165890    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165893    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165895    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165898    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165900    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165903    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165906    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165908    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165911    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165914    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165916    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165919    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165922    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165924    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165927    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165930    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.174592 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165933    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165935    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165938    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165940    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165943    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165946    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165948    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165951    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165953    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165956    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165958    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165961    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165963    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165967    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165970    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165973    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165975    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165978    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165981    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165983    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.175063 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165986    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165988    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165991    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165994    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.165997    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166001    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166005    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166008    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166011    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166013    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166016    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166019    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166022    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166024    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.166050    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:37:18.175537 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166092    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166097    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166100    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166104    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166107    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166110    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166113    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166116    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166118    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166121    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166123    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166128    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166130    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166133    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166136    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166138    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166143    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166145    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166148    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166150    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.175890 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166153    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166155    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166158    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166160    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166163    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166165    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166168    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166170    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166173    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166176    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166179    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166182    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166184    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166187    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166190    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166192    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166195    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166197    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166200    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166202    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.176449 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166205    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166207    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166210    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166214    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166216    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166219    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166221    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166236    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166240    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166242    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166245    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166248    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166250    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166253    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166256    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166258    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166261    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166263    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166266    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.176948 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166269    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166271    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166274    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166276    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166279    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166282    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166286    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166288    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166291    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166294    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166296    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166299    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166301    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166303    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166306    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166308    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166313    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166315    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166318    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166321    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.177404 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166325    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166329    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166332    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166335    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166338    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166342    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166344    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166347    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166349    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166352    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166354    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166357    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166360    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166362    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166365    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166367    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166370    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166373    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166375    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.177910 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166378    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166382    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166386    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166389    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166392    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166395    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166397    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.166401    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.173047    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.173063    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.173076    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.173081    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173136    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173141    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173144    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173147    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173149    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173152    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173155    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.178366 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173158    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173161    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173164    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173167    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173169    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173173    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173175    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173178    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173181    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173184    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173186    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173189    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173191    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173194    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173197    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173200    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173202    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173205    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173208    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173210    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.178802 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173213    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173216    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173219    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173234    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173237    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173239    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173243    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173246    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173248    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173251    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173254    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173256    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173259    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173262    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173264    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173267    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173270    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173272    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173275    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173278    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.179271 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173280    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173283    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173285    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173288    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173290    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173293    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173295    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173298    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173301    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173303    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173306    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173309    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173312    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173314    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173317    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173320    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173323    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173325    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173328    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173330    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.179765 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173333    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173335    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173338    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173340    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173343    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173345    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173348    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173350    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173353    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173355    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173358    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173360    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173363    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173365    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173368    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173370    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173373    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173375    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173378    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.180216 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173380    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173383    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173385    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173389    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173393    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173397    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173400    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173403    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173406    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173410    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173414    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173418    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173421    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173424    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173427    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173430    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173432    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173436    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173438    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.180680 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173441    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.173468    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173600    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173605    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173608    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173611    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173614    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173617    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173620    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173622    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173625    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173628    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173631    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173633    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173636    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173638    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.181122 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173641    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173644    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173646    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173649    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173652    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173654    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173657    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173662    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173666    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173669    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173673    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173675    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173678    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173681    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173684    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173687    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173690    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173694    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173697    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.181516 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173700    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173702    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173705    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173708    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173710    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173712    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173715    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173717    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173720    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173723    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173725    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173727    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173730    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173732    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173735    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173738    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173741    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173744    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173746    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173749    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.182002 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173751    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173754    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173757    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173760    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173762    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173765    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173767    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173770    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173772    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173775    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173777    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173780    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173782    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173785    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173787    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173790    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173792    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173795    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173797    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173800    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.182569 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173802    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173805    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173808    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173811    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173814    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173816    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173819    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173821    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173824    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173827    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173829    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173832    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173834    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173837    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173842    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173846    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173848    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173851    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173853    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.183111 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173856    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173858    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173861    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173863    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173866    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173868    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173871    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173873    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173876    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173879    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173881    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173884    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173887    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173889    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.173912    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173942    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:18.183582 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173946    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173949    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173954    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173957    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173960    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173963    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173966    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173969    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173971    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173974    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173977    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173981    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173985    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173988    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173990    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173993    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173995    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.173998    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174001    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:18.183955 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174003    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174006    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174010    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174013    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174016    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174019    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174022    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174025    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174028    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174030    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174033    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174051    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174055    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174058    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174061    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174066    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174068    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174071    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174074    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174076    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:18.184427 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174079    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174081    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174084    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174087    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174090    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174093    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174096    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174098    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174101    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174104    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174106    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174109    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174112    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174115    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174117    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174120    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174122    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174125    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174128    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174130    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:18.184896 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174134    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174136    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174139    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174141    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174144    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174147    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174149    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174153    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174156    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174159    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174161    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174164    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174167    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174169    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174172    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174175    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174177    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174180    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174182    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174185    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:18.185375 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174188    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174190    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174193    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174196    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174198    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174201    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174203    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174206    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174208    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174210    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174213    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174216    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174218    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174221    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174235    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174238    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174240    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174243    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174246    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:18.185863 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174250    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174253    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174256    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174258    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174261    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174263    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:18.174266    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.174319    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.176358    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.177342    2577 server.go:1014] "Starting client certificate rotation"
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.177438    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.178297    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.179607    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:37:18.186313 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.185256    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:37:18.197480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.197464    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 30 18:37:18.201057 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.201042    2577 log.go:25] "Validated CRI v1 image API"
Oct 30 18:37:18.201894 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.201872    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 18:37:18.207214 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.207194    2577 fs.go:135] Filesystem UUIDs: map[421749ad-0cdc-455b-97a7-c96509ac0904:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ced88d29-12c8-49a9-9899-c5b8dc9133ac:/dev/nvme0n1p3]
Oct 30 18:37:18.207273 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.207214    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 18:37:18.211386 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.211278    2577 manager.go:217] Machine: {Timestamp:2026-10-30 18:37:18.210815596 +0000 UTC m=+0.366223160 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097780 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b80a11013516ce53334ee11c5c0cd SystemUUID:ec2b80a1-1013-516c-e533-34ee11c5c0cd BootID:80b67a1a-e718-4f64-b8da-9ce035fca3c1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:e2:f3:2b:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:e2:f3:2b:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:3d:2d:57:2a:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 18:37:18.211386 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.211384    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 18:37:18.211494 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.211450    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 18:37:18.214136 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.214112    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 18:37:18.214277 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.214137    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-244.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 18:37:18.214359 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.214281    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 18:37:18.214359 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.214289    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 18:37:18.214359 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.214298    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:37:18.215237 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.215219    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:37:18.216269 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.216260    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 18:37:18.219628 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.219616    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 18:37:18.219740 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.219731    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 18:37:18.220584 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.220575    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 18:37:18.220621 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.220587    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 18:37:18.220621 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.220601    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 18:37:18.220621 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.220611    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 30 18:37:18.220621 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.220619    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 18:37:18.220899 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.220887    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:37:18.223395 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.223378    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 18:37:18.229355 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.229342    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:37:18.230443 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230431    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 18:37:18.230479 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230461    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 18:37:18.230616 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230607    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 18:37:18.230645 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230622    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 18:37:18.230645 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230629    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 18:37:18.230645 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230635    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 18:37:18.230645 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230641    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 18:37:18.230745 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.230648    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 18:37:18.231315 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.231306    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 18:37:18.231350 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.231316    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 18:37:18.231350 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.231324    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 18:37:18.231350 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.231331    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 18:37:18.231350 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.231339    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 18:37:18.231350 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.231350    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 18:37:18.232131 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.232123    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 18:37:18.232163 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.232132    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 18:37:18.235802 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.235791    2577 server.go:1263] "Started kubelet"
Oct 30 18:37:18.235922 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.235893    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 18:37:18.235922 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.235891    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 18:37:18.237584 ip-10-0-133-244 systemd[1]: Started Kubernetes Kubelet.
Oct 30 18:37:18.238692 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.238665    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 18:37:18.239929 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.239908    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 18:37:18.240496 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.240483    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 18:37:18.243367 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.243344    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 18:37:18.246811 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.246794    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 18:37:18.247337 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.247317    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 18:37:18.247430 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.247413    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:18.248060 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248044    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 18:37:18.248060 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248061    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 18:37:18.248206 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248043    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 18:37:18.248206 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248142    2577 factory.go:55] Registering systemd factory
Oct 30 18:37:18.248206 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248154    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 30 18:37:18.248206 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248191    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 18:37:18.248206 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248200    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 18:37:18.248380 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248365    2577 factory.go:153] Registering CRI-O factory
Oct 30 18:37:18.248408 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248380    2577 factory.go:223] Registration of the crio container factory successfully
Oct 30 18:37:18.248438 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248432    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 18:37:18.248467 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248453    2577 factory.go:103] Registering Raw factory
Oct 30 18:37:18.248495 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.248469    2577 manager.go:1199] Started watching for new ooms in manager
Oct 30 18:37:18.249435 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.249413    2577 manager.go:319] Starting recovery of all containers
Oct 30 18:37:18.259681 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.259663    2577 manager.go:324] Recovery completed
Oct 30 18:37:18.263895 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.263881    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.266571 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.266555    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.266641 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.266583    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.266641 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.266593    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.267101 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.267090    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.267156 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.267091    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 30 18:37:18.267156 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.267150    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 18:37:18.267278 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.267173    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 18:37:18.268749 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.268732    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.268827 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.268762    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.268827 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.268776    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.269553 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.269540    2577 policy_none.go:50] "Start"
Oct 30 18:37:18.269634 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.269556    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 18:37:18.269634 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.269569    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 18:37:18.270933 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.270920    2577 policy_none.go:44] "Start"
Oct 30 18:37:18.295920 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.295890    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 18:37:18.298326 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298312    2577 manager.go:341] "Starting Device Plugin manager"
Oct 30 18:37:18.298387 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.298345    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 18:37:18.298387 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298357    2577 server.go:87] "Starting device plugin registration server"
Oct 30 18:37:18.298586 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298573    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 18:37:18.298620 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298590    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 18:37:18.298738 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298721    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 18:37:18.298904 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298810    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 18:37:18.298904 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.298819    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 18:37:18.299240 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.299206    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 18:37:18.299293 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.299275    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:18.374712 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.374684    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-244.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 18:37:18.374797 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.374685    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-244.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 18:37:18.375718 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.374662    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-244.us-west-2.compute.internal.18e3628de766a5b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-244.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-244.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 18:37:18.235764148 +0000 UTC m=+0.391171713,LastTimestamp:2026-10-30 18:37:18.235764148 +0000 UTC m=+0.391171713,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-244.us-west-2.compute.internal,}"
Oct 30 18:37:18.399272 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.399253    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.400030 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.400010    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.400119 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.400036    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.400119 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.400046    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.400119 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.400068    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.435712 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.435690    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 18:37:18.437271 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.436877    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 18:37:18.437271 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.436903    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 18:37:18.437271 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.436922    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 18:37:18.437271 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.436959    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 18:37:18.508278 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.508261    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 18:37:18.508374 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.508316    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5b59n"
Oct 30 18:37:18.522800 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.522767    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 18:37:18.522800 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.522767    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 18:37:18.522800 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.522728    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-244.us-west-2.compute.internal.18e3628de93cb486  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-244.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-244.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-244.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 18:37:18.266569862 +0000 UTC m=+0.421977427,LastTimestamp:2026-10-30 18:37:18.266569862 +0000 UTC m=+0.421977427,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-244.us-west-2.compute.internal,}"
Oct 30 18:37:18.523094 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.523077    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-244.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 18:37:18.537644 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.537622    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"]
Oct 30 18:37:18.537693 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.537674    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.539770 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.539755    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.539840 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.539781    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.539840 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.539795    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.541375 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.541363    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.541530 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.541515    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.541565 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.541545    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.542092 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.542072    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.542166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.542107    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.542166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.542123    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.542166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.542107    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.542281 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.542190    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.542281 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.542207    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.543508 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.543493    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.543607 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.543516    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.544401 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.544384    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.544471 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.544414    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.544471 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.544428    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.550202 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.550184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.550302 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.550209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/280f4af3efbb64161ef5d0dff38bf2c2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"280f4af3efbb64161ef5d0dff38bf2c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.550302 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.550242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.563238 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.563211    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.567022 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.567003    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.602018 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.601999    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:18.622677 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.622659    2577 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-133-244.us-west-2.compute.internal\" not found" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.651732 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.651712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.651802 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.651738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.651802 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.651755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/280f4af3efbb64161ef5d0dff38bf2c2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"280f4af3efbb64161ef5d0dff38bf2c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.651802 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.651798    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/280f4af3efbb64161ef5d0dff38bf2c2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"280f4af3efbb64161ef5d0dff38bf2c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.651901 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.651802    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.651901 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.651813    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.687487 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.687440    2577 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-244.us-west-2.compute.internal\" not found" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.823689 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.823670    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:18.825019 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.825004    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:18.825108 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.825031    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:18.825108 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.825049    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:18.825108 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.825077    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.867858 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.867840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.870899 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.870879    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.893180 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:18.893058    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:18.893294 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:18.893184    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-244.us-west-2.compute.internal\": node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.048498 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.048438    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.149299 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.149273    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.177679 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.177662    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 18:37:19.178056 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.177809    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 18:37:19.178056 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.177820    2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a1170fdc21ac14235b67aafb8b26d5e9-34204dc823c30344.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-133-244.us-west-2.compute.internal.18e3628de93cf875\": read tcp 10.0.133.244:46934->3.143.200.93:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-133-244.us-west-2.compute.internal.18e3628de93cf875  default   5211 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-244.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-244.us-west-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-244.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 18:37:18 +0000 UTC,LastTimestamp:2026-10-30 18:37:18.400040771 +0000 UTC m=+0.555448336,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-244.us-west-2.compute.internal,}"
Oct 30 18:37:19.249624 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.249601    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.351157 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.351109    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.451315 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.451288    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.512804 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.512765    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:32:19 +0000 UTC" deadline="2028-06-21 03:45:05.360526462 +0000 UTC"
Oct 30 18:37:19.512890 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.512820    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14385h7m45.847729932s"
Oct 30 18:37:19.528032 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.528016    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:19.529024 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.529007    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:19.529116 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.529036    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:19.529116 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.529047    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:19.552429 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.552404    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.653515 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.653469    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.753826 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:19.753800    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:37:19.764597 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.764579    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:19.847749 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.847720    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:19.915705 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.915652    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:37:19.917832 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.917808    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:37:19.938797 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:19.938767    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fd34ddbb219fc4a25ad1761211ca99.slice/crio-76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d WatchSource:0}: Error finding container 76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d: Status 404 returned error can't find the container with id 76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d
Oct 30 18:37:19.945134 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:19.945117    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 18:37:19.945763 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:19.945742    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280f4af3efbb64161ef5d0dff38bf2c2.slice/crio-6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72 WatchSource:0}: Error finding container 6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72: Status 404 returned error can't find the container with id 6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72
Oct 30 18:37:20.009634 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.009608    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:20.009743 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.009727    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:37:20.046652 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.046630    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:20.223950 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.223889    2577 apiserver.go:52] "Watching apiserver"
Oct 30 18:37:20.250011 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.249991    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 18:37:20.338127 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.338106    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 18:37:20.338452 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.338433    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-b2t2n","openshift-multus/multus-p4kbp","kube-system/konnectivity-agent-g66m2","openshift-cluster-node-tuning-operator/tuned-l7ln5","openshift-dns/node-resolver-hqx6v","openshift-multus/network-metrics-daemon-29tfr","openshift-network-operator/iptables-alerter-fckwv","openshift-image-registry/node-ca-wn9rz","openshift-ovn-kubernetes/ovnkube-node-fvgxt","kube-system/global-pull-secret-syncer-rq9kn","kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal","openshift-network-diagnostics/network-check-target-pqztj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"]
Oct 30 18:37:20.342591 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.342574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.344805 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.344783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.346459 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.346432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.348673 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.348649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.350518 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.350499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.352402 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.352381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:20.352513 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.352458    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:20.354199 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.354153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.356179 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.356053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.358316 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358291    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.358840 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysconfig\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.358932 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-sys\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.358932 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-socket-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.358932 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-registration-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.358932 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.359120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.358969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpzr7\" (UniqueName: \"kubernetes.io/projected/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kube-api-access-tpzr7\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.359120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-kubernetes\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.359120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.359120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359066    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-tmp\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.359120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-system-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-cnibin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359378 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-socket-dir-parent\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359378 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66qk\" (UniqueName: \"kubernetes.io/projected/e51c4bdb-690c-4608-b2ee-ba870b79719c-kube-api-access-v66qk\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359378 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a029bb1-97b8-4018-94f9-20b06c34db89-konnectivity-ca\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.359378 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.359548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-sys-fs\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.359548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-kubelet\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-hostroot\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-etc-kubernetes\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-systemd\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-k8s-cni-cncf-io\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-conf-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a029bb1-97b8-4018-94f9-20b06c34db89-agent-certs\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-etc-tuned\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrkpj\" (UniqueName: \"kubernetes.io/projected/764ba139-faa5-4431-b64e-d3e0d2866470-kube-api-access-vrkpj\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-netns\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.359801 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-daemon-config\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-modprobe-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-run\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-var-lib-kubelet\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-device-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.359972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-multus\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-conf\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.360078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-lib-modules\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.360298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-cni-binary-copy\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.360298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-bin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.360298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-multus-certs\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.360298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-host\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.360298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.360305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.360464 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.360367    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:20.362015 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.361998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:20.362088 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.362049    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:20.364493 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.364475    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.409969 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.409937    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 18:37:20.410118 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.410098    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j99tc\""
Oct 30 18:37:20.410176 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.410154    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hlrng\""
Oct 30 18:37:20.410176 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.410160    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-czdz5\""
Oct 30 18:37:20.410176 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.410172    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 18:37:20.410321 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.410198    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-lp85d\""
Oct 30 18:37:20.410321 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.410209    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqqcl\""
Oct 30 18:37:20.411105 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411089    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.411245 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411231    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 18:37:20.411291 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411233    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.411291 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411269    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.411382 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411356    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.411439 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411426    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 18:37:20.411478 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411458    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.411515 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411491    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.411515 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411499    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.411575 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411547    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 18:37:20.411575 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.411569    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.413917 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.413904    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 18:37:20.413971 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.413959    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 18:37:20.414223 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.414211    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4rg2h\""
Oct 30 18:37:20.419486 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.419473    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 18:37:20.441144 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.441101    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"b1fd34ddbb219fc4a25ad1761211ca99","Type":"ContainerStarted","Data":"76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d"}
Oct 30 18:37:20.442141 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.442122    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"280f4af3efbb64161ef5d0dff38bf2c2","Type":"ContainerStarted","Data":"6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72"}
Oct 30 18:37:20.449060 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.449039    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 18:37:20.460896 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.460872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66qk\" (UniqueName: \"kubernetes.io/projected/e51c4bdb-690c-4608-b2ee-ba870b79719c-kube-api-access-v66qk\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.460970 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.460912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.460970 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.460934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.460970 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.460960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-sys-fs\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.461076 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-kubelet\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461076 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461034    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.461076 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-etc-kubernetes\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461077    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-etc-kubernetes\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461081    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-kubelet\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7f00c4d-1310-4e08-ba66-d9720844b86f-serviceca\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.461166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4rn\" (UniqueName: \"kubernetes.io/projected/5682428d-476a-4cd6-b4c4-a17675fea5f2-kube-api-access-gj4rn\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:20.461166 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461129    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-sys-fs\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db75277c-76a4-4127-b5c2-d6bead6f6db2-tmp-dir\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf67f\" (UniqueName: \"kubernetes.io/projected/f7f00c4d-1310-4e08-ba66-d9720844b86f-kube-api-access-vf67f\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-slash\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9581611c-5430-475b-bd37-26c7e13b3fbd-ovn-node-metrics-cert\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-dbus\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-node-log\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8cbz\" (UniqueName: \"kubernetes.io/projected/9581611c-5430-475b-bd37-26c7e13b3fbd-kube-api-access-n8cbz\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-var-lib-kubelet\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-bin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461503    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-var-lib-kubelet\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461519    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-bin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7473358-5d80-4235-9f4f-f72c00a84d55-iptables-alerter-script\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.461665 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-etc-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-log-socket\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cnibin\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysconfig\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461827    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysconfig\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-sys\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461924    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-sys\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-ovn\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-netd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461972    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.461995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db75277c-76a4-4127-b5c2-d6bead6f6db2-hosts-file\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.462014 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-kubernetes\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-tmp\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a029bb1-97b8-4018-94f9-20b06c34db89-konnectivity-ca\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462116    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-kubernetes\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hpgf\" (UniqueName: \"kubernetes.io/projected/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-kube-api-access-5hpgf\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-systemd-units\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-bin\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462208    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dccn\" (UniqueName: \"kubernetes.io/projected/db75277c-76a4-4127-b5c2-d6bead6f6db2-kube-api-access-9dccn\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-hostroot\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-hostroot\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjqb\" (UniqueName: \"kubernetes.io/projected/e7473358-5d80-4235-9f4f-f72c00a84d55-kube-api-access-vhjqb\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-kubelet\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-netns\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-systemd\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.462694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-k8s-cni-cncf-io\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462582    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-systemd\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-conf-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462603    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-k8s-cni-cncf-io\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462623    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a029bb1-97b8-4018-94f9-20b06c34db89-agent-certs\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462769    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-conf-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-kubelet-config\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-etc-tuned\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkpj\" (UniqueName: \"kubernetes.io/projected/764ba139-faa5-4431-b64e-d3e0d2866470-kube-api-access-vrkpj\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-netns\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462901    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a029bb1-97b8-4018-94f9-20b06c34db89-konnectivity-ca\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-daemon-config\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-modprobe-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462952    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-netns\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.462969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-run\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-device-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.463480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-multus\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f00c4d-1310-4e08-ba66-d9720844b86f-host\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7473358-5d80-4235-9f4f-f72c00a84d55-host-slash\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-conf\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463125    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-device-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-lib-modules\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-cni-binary-copy\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463172    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-multus\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-multus-certs\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-host\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463272    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-conf\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-config\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463333    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-host\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463339    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-multus-certs\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463374    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-run\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-env-overrides\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.464393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463334    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-lib-modules\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-socket-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463440    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-daemon-config\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-registration-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463536    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-socket-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463577    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-registration-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpzr7\" (UniqueName: \"kubernetes.io/projected/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kube-api-access-tpzr7\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-systemd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-var-lib-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-script-lib\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463884    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-modprobe-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-system-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-cnibin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463949    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-system-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.463958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-socket-dir-parent\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.464000    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-cnibin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.465250 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.464016    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-socket-dir-parent\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.466148 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.464529    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-cni-binary-copy\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.466297 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.466280    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-tmp\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.466372 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.466356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-etc-tuned\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.466892 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.466875    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a029bb1-97b8-4018-94f9-20b06c34db89-agent-certs\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.467342 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.467324    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 18:37:20.467390 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.467363    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vcwzw"
Oct 30 18:37:20.508187 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.508135    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:20.524623 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.524599    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 18:37:20.524719 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.524653    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.524719 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.524672    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.524719 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.524686    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.524847 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.524717    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.524999 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.524978    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 18:37:20.525107 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525001    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 18:37:20.525107 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525012    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 18:37:20.525107 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525020    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 18:37:20.525107 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525012    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lfj5d\""
Oct 30 18:37:20.525107 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525050    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 18:37:20.525107 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525055    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gh5g8\""
Oct 30 18:37:20.525340 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525157    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 18:37:20.525340 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.525191    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9cgrs\""
Oct 30 18:37:20.565048 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db75277c-76a4-4127-b5c2-d6bead6f6db2-hosts-file\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.565153 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpgf\" (UniqueName: \"kubernetes.io/projected/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-kube-api-access-5hpgf\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.565153 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-systemd-units\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565153 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-bin\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565153 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565135    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db75277c-76a4-4127-b5c2-d6bead6f6db2-hosts-file\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.565385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dccn\" (UniqueName: \"kubernetes.io/projected/db75277c-76a4-4127-b5c2-d6bead6f6db2-kube-api-access-9dccn\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.565385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:20.565385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565260    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-bin\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjqb\" (UniqueName: \"kubernetes.io/projected/e7473358-5d80-4235-9f4f-f72c00a84d55-kube-api-access-vhjqb\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.565385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-kubelet\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-netns\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-kubelet-config\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565437    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-netns\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f00c4d-1310-4e08-ba66-d9720844b86f-host\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565402    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-kubelet\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7473358-5d80-4235-9f4f-f72c00a84d55-host-slash\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565489    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-config\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565547    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f00c4d-1310-4e08-ba66-d9720844b86f-host\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565551    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-kubelet-config\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.565659 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-env-overrides\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566158 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.566158 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-systemd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566158 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-var-lib-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566158 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-script-lib\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566158 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566414 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7f00c4d-1310-4e08-ba66-d9720844b86f-serviceca\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.566414 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566232    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-systemd-units\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566414 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.565581    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7473358-5d80-4235-9f4f-f72c00a84d55-host-slash\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.566414 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566361    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.566414 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4rn\" (UniqueName: \"kubernetes.io/projected/5682428d-476a-4cd6-b4c4-a17675fea5f2-kube-api-access-gj4rn\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:20.566640 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566756    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-config\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db75277c-76a4-4127-b5c2-d6bead6f6db2-tmp-dir\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566821    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-systemd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf67f\" (UniqueName: \"kubernetes.io/projected/f7f00c4d-1310-4e08-ba66-d9720844b86f-kube-api-access-vf67f\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-slash\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566899    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-var-lib-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9581611c-5430-475b-bd37-26c7e13b3fbd-ovn-node-metrics-cert\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566869    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.566943    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-script-lib\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567104    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-env-overrides\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-dbus\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db75277c-76a4-4127-b5c2-d6bead6f6db2-tmp-dir\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-node-log\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567265    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-slash\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567347    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-dbus\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567390    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7f00c4d-1310-4e08-ba66-d9720844b86f-serviceca\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.567825 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567441    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-node-log\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cbz\" (UniqueName: \"kubernetes.io/projected/9581611c-5430-475b-bd37-26c7e13b3fbd-kube-api-access-n8cbz\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.567607    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.567675    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:37:21.067654413 +0000 UTC m=+3.223061989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567768    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.567897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7473358-5d80-4235-9f4f-f72c00a84d55-iptables-alerter-script\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-etc-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-log-socket\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cnibin\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568181    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568232    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-etc-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-ovn\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571132 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-netd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568343    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cnibin\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568385    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-log-socket\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568407    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-netd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568444    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-ovn\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568494    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.568501    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.568586    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:21.068561793 +0000 UTC m=+3.223969377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.568696    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7473358-5d80-4235-9f4f-f72c00a84d55-iptables-alerter-script\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.570832    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9581611c-5430-475b-bd37-26c7e13b3fbd-ovn-node-metrics-cert\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.571701 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.571009    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66qk\" (UniqueName: \"kubernetes.io/projected/e51c4bdb-690c-4608-b2ee-ba870b79719c-kube-api-access-v66qk\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.572988 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.572967    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpzr7\" (UniqueName: \"kubernetes.io/projected/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kube-api-access-tpzr7\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.573331 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.573314    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkpj\" (UniqueName: \"kubernetes.io/projected/764ba139-faa5-4431-b64e-d3e0d2866470-kube-api-access-vrkpj\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.631825 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.631802    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:20.631900 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.631828    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:20.631900 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.631842    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:20.631974 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:20.631899    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:37:21.131882838 +0000 UTC m=+3.287290411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:20.633897 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.633871    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjqb\" (UniqueName: \"kubernetes.io/projected/e7473358-5d80-4235-9f4f-f72c00a84d55-kube-api-access-vhjqb\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.634721 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.634701    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpgf\" (UniqueName: \"kubernetes.io/projected/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-kube-api-access-5hpgf\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.634901 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.634883    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf67f\" (UniqueName: \"kubernetes.io/projected/f7f00c4d-1310-4e08-ba66-d9720844b86f-kube-api-access-vf67f\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.635020 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.634999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dccn\" (UniqueName: \"kubernetes.io/projected/db75277c-76a4-4127-b5c2-d6bead6f6db2-kube-api-access-9dccn\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.636533 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.636516    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cbz\" (UniqueName: \"kubernetes.io/projected/9581611c-5430-475b-bd37-26c7e13b3fbd-kube-api-access-n8cbz\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.638973 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.638950    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4rn\" (UniqueName: \"kubernetes.io/projected/5682428d-476a-4cd6-b4c4-a17675fea5f2-kube-api-access-gj4rn\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:20.657038 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.657015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:37:20.661261 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.661249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p4kbp"
Oct 30 18:37:20.666777 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.666755    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f9c425_4dc6_48c2_9db0_11dc60b2d1c5.slice/crio-3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6 WatchSource:0}: Error finding container 3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6: Status 404 returned error can't find the container with id 3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6
Oct 30 18:37:20.668593 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.668577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:20.669497 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.669469    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51c4bdb_690c_4608_b2ee_ba870b79719c.slice/crio-b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04 WatchSource:0}: Error finding container b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04: Status 404 returned error can't find the container with id b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04
Oct 30 18:37:20.674942 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.674927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:37:20.676518 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.676500    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a029bb1_97b8_4018_94f9_20b06c34db89.slice/crio-4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0 WatchSource:0}: Error finding container 4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0: Status 404 returned error can't find the container with id 4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0
Oct 30 18:37:20.681186 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.681169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:37:20.683983 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.683962    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764ba139_faa5_4431_b64e_d3e0d2866470.slice/crio-0069c17a1162336e22cf1e7b21a797b9d6b2cfafd7c7f460c9694c4b4704179b WatchSource:0}: Error finding container 0069c17a1162336e22cf1e7b21a797b9d6b2cfafd7c7f460c9694c4b4704179b: Status 404 returned error can't find the container with id 0069c17a1162336e22cf1e7b21a797b9d6b2cfafd7c7f460c9694c4b4704179b
Oct 30 18:37:20.688521 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.688501    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb75277c_76a4_4127_b5c2_d6bead6f6db2.slice/crio-71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d WatchSource:0}: Error finding container 71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d: Status 404 returned error can't find the container with id 71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d
Oct 30 18:37:20.695458 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.695443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:37:20.697623 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.697606    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:37:20.704255 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.704234    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1148f4_6adb_46ec_96c8_d33ca9883fbd.slice/crio-b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f WatchSource:0}: Error finding container b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f: Status 404 returned error can't find the container with id b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f
Oct 30 18:37:20.706140 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.706121    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7473358_5d80_4235_9f4f_f72c00a84d55.slice/crio-48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726 WatchSource:0}: Error finding container 48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726: Status 404 returned error can't find the container with id 48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726
Oct 30 18:37:20.707648 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.707627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:37:20.711407 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:20.711390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:20.715646 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.715612    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f00c4d_1310_4e08_ba66_d9720844b86f.slice/crio-8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0 WatchSource:0}: Error finding container 8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0: Status 404 returned error can't find the container with id 8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0
Oct 30 18:37:20.719699 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:37:20.719680    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9581611c_5430_475b_bd37_26c7e13b3fbd.slice/crio-b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2 WatchSource:0}: Error finding container b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2: Status 404 returned error can't find the container with id b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2
Oct 30 18:37:21.072837 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.072355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:21.072837 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.072413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:21.072837 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.072534    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:21.072837 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.072568    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:21.072837 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.072602    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:37:22.072582877 +0000 UTC m=+4.227990449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:21.072837 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.072624    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:22.072612725 +0000 UTC m=+4.228020284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:21.173423 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.173391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:21.173614 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.173588    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:21.173708 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.173619    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:21.173708 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.173632    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:21.173708 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.173695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:37:22.173676837 +0000 UTC m=+4.329084394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:21.438130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.438034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:21.438866 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:21.438161    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:21.446149 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.446116    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p4kbp" event={"ID":"e51c4bdb-690c-4608-b2ee-ba870b79719c","Type":"ContainerStarted","Data":"b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04"}
Oct 30 18:37:21.449156 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.447589    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj" event={"ID":"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5","Type":"ContainerStarted","Data":"3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6"}
Oct 30 18:37:21.449156 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.448911    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fckwv" event={"ID":"e7473358-5d80-4235-9f4f-f72c00a84d55","Type":"ContainerStarted","Data":"48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726"}
Oct 30 18:37:21.450203 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.450175    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerStarted","Data":"b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f"}
Oct 30 18:37:21.451440 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.451412    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hqx6v" event={"ID":"db75277c-76a4-4127-b5c2-d6bead6f6db2","Type":"ContainerStarted","Data":"71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d"}
Oct 30 18:37:21.452876 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.452851    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g66m2" event={"ID":"4a029bb1-97b8-4018-94f9-20b06c34db89","Type":"ContainerStarted","Data":"4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0"}
Oct 30 18:37:21.454392 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.454366    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2"}
Oct 30 18:37:21.455829 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.455803    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wn9rz" event={"ID":"f7f00c4d-1310-4e08-ba66-d9720844b86f","Type":"ContainerStarted","Data":"8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0"}
Oct 30 18:37:21.457239 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.457199    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l7ln5" event={"ID":"764ba139-faa5-4431-b64e-d3e0d2866470","Type":"ContainerStarted","Data":"0069c17a1162336e22cf1e7b21a797b9d6b2cfafd7c7f460c9694c4b4704179b"}
Oct 30 18:37:21.470510 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.470482    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:32:21 +0000 UTC" deadline="2028-06-15 10:31:24.703729164 +0000 UTC"
Oct 30 18:37:21.470510 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:21.470518    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14247h54m3.233223841s"
Oct 30 18:37:22.081980 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.081936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:22.082177 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.081994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:22.082177 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.082107    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:22.082177 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.082177    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:37:24.082154908 +0000 UTC m=+6.237562466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:22.082395 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.082107    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:22.082395 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.082227    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:24.082215694 +0000 UTC m=+6.237623251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:22.182598 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.182557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:22.182812 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.182794    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:22.182896 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.182820    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:22.182896 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.182834    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:22.182896 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.182890    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:37:24.182872788 +0000 UTC m=+6.338280358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:22.439688 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.439613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:22.440168 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.439802    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:22.440168 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.439981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:22.440168 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:22.440081    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:22.470776 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.470669    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:32:21 +0000 UTC" deadline="2028-07-03 13:08:03.726676751 +0000 UTC"
Oct 30 18:37:22.470776 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:22.470748    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14682h30m41.255933927s"
Oct 30 18:37:23.437344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:23.437257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:23.437538 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:23.437402    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:24.105784 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.105146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:24.105784 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.105486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:24.105784 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.105602    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:24.105784 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.105647    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:37:28.105634245 +0000 UTC m=+10.261041814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:24.105784 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.105692    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:24.105784 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.105714    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:28.105706683 +0000 UTC m=+10.261114250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:24.206749 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.206674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:24.206863 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.206840    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:24.206940 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.206867    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:24.206940 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.206881    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:24.207050 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.206941    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:37:28.20692136 +0000 UTC m=+10.362328930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:24.437923 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.437609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:24.437923 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.437747    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:24.437923 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.437815    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:24.437923 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:24.437887    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:24.491886 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.491845    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1fd34ddbb219fc4a25ad1761211ca99" containerID="7760a9a7d7505d1a1defdd003602d22e3e22189b883ce6d0d88431fa465d5bff" exitCode=0
Oct 30 18:37:24.492342 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.492288    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"b1fd34ddbb219fc4a25ad1761211ca99","Type":"ContainerDied","Data":"7760a9a7d7505d1a1defdd003602d22e3e22189b883ce6d0d88431fa465d5bff"}
Oct 30 18:37:24.497262 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.496803    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerStarted","Data":"9f9026d760b5abee0596d4fb2805a533e047f8a8ca4cf40b4c1de8af2f62ba91"}
Oct 30 18:37:24.505788 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:24.505415    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"280f4af3efbb64161ef5d0dff38bf2c2","Type":"ContainerStarted","Data":"e373aad4de3b964ecfa4969dd117f48e07ccaa955f07dcc9753613a741dcf73e"}
Oct 30 18:37:25.437862 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:25.437826    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:25.438416 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:25.437959    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:25.516149 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:25.516105    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="9f9026d760b5abee0596d4fb2805a533e047f8a8ca4cf40b4c1de8af2f62ba91" exitCode=0
Oct 30 18:37:25.516343 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:25.516220    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerDied","Data":"9f9026d760b5abee0596d4fb2805a533e047f8a8ca4cf40b4c1de8af2f62ba91"}
Oct 30 18:37:25.523760 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:25.523724    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"b1fd34ddbb219fc4a25ad1761211ca99","Type":"ContainerStarted","Data":"385043f973dba81283992276f2074ce138d915ceb7febb5e7ae1ea366d43346a"}
Oct 30 18:37:25.655754 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:25.655492    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" podStartSLOduration=5.655472151 podStartE2EDuration="5.655472151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:24.88059738 +0000 UTC m=+7.036004958" watchObservedRunningTime="2026-10-30 18:37:25.655472151 +0000 UTC m=+7.810879730"
Oct 30 18:37:26.437795 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:26.437763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:26.437967 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:26.437894    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:26.438344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:26.437709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:26.438426 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:26.438413    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:26.534798 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:26.534764    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g66m2" event={"ID":"4a029bb1-97b8-4018-94f9-20b06c34db89","Type":"ContainerStarted","Data":"62ff7a43affc68d2786e44c0a0d88f897b37176d2f0058a7d0f0d9ee3ec66f01"}
Oct 30 18:37:26.665047 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:26.664981    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" podStartSLOduration=6.664960917 podStartE2EDuration="6.664960917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:25.784410342 +0000 UTC m=+7.939817921" watchObservedRunningTime="2026-10-30 18:37:26.664960917 +0000 UTC m=+8.820368495"
Oct 30 18:37:26.926126 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:26.926083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:27.321876 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:27.321842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:27.438142 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:27.438063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:27.438637 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:27.438200    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:27.541458 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:27.541424    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wn9rz" event={"ID":"f7f00c4d-1310-4e08-ba66-d9720844b86f","Type":"ContainerStarted","Data":"04b776af54e40d6b84a98854701c031f3bbadd86fdcfa176263e5f901d181dc1"}
Oct 30 18:37:27.546089 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:27.546066    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj" event={"ID":"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5","Type":"ContainerStarted","Data":"70ddc362dfdadb8cf175e348bce3825ce8af0fc4f003c63416fac5f690e93614"}
Oct 30 18:37:27.674556 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:27.674494    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g66m2" podStartSLOduration=3.6971342419999997 podStartE2EDuration="8.674473521s" totalImagesPullingTime="4.977339279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:26.666073146 +0000 UTC m=+8.821480725" watchObservedRunningTime="2026-10-30 18:37:27.674473521 +0000 UTC m=+9.829881102"
Oct 30 18:37:28.141842 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:28.141785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:28.142025 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:28.141886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:28.142099 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.142028    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:28.142099 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.142092    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:37:36.142073564 +0000 UTC m=+18.297481138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:28.142437 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.142414    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:28.142526 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.142485    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:36.142467087 +0000 UTC m=+18.297874660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:28.243116 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:28.243076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:28.243290 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.243259    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:28.243366 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.243299    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:28.243366 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.243314    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:28.243467 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.243385    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:37:36.243364425 +0000 UTC m=+18.398771995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:28.441229 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:28.441155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:28.441757 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.441289    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:28.441757 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:28.441711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:28.441869 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:28.441823    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:29.437721 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:29.437533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:29.437721 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:29.437665    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:29.566809 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:29.565895    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p4kbp" event={"ID":"e51c4bdb-690c-4608-b2ee-ba870b79719c","Type":"ContainerStarted","Data":"7d61ecea6e7dee897f4a06d79f58bd3022540070c625f5bc8bf0778ac6ef753a"}
Oct 30 18:37:29.595748 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:29.595691    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 18:37:29.702510 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:29.702421    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wn9rz" podStartSLOduration=3.419767697 podStartE2EDuration="9.702401582s" totalImagesPullingTime="6.282633885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:27.674084692 +0000 UTC m=+9.829492275" watchObservedRunningTime="2026-10-30 18:37:29.702401582 +0000 UTC m=+11.857809161"
Oct 30 18:37:29.703370 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:29.703324    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-p4kbp" podStartSLOduration=2.063879818 podStartE2EDuration="10.703299419s" totalImagesPullingTime="8.639419601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:29.702336729 +0000 UTC m=+11.857744307" watchObservedRunningTime="2026-10-30 18:37:29.703299419 +0000 UTC m=+11.858706998"
Oct 30 18:37:29.966740 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:29.966659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:30.182108 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.182076    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:30.307970 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.307858    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:37:29.595718284Z","UUID":"074575fc-ce05-4eb9-82ff-4033d2455545","Handler":null,"Name":"","Endpoint":""}
Oct 30 18:37:30.309499 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.309476    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 18:37:30.309608 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.309546    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 18:37:30.438055 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.437563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:30.438055 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:30.437729    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:30.438055 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.437790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:30.438055 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:30.437928    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:30.570113 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.570071    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj" event={"ID":"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5","Type":"ContainerStarted","Data":"87ff18c4dd40fe0bcec09ff33244e8e731002683aad8d5ed5a571e90858bae57"}
Oct 30 18:37:30.572623 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.572592    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="68c3c48cc31214407ff30cb78d7ae2eafdb0f80ab5cafdc8ed19854269bfbcb9" exitCode=0
Oct 30 18:37:30.572764 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.572684    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerDied","Data":"68c3c48cc31214407ff30cb78d7ae2eafdb0f80ab5cafdc8ed19854269bfbcb9"}
Oct 30 18:37:30.576249 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.576225    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hqx6v" event={"ID":"db75277c-76a4-4127-b5c2-d6bead6f6db2","Type":"ContainerStarted","Data":"839c6e6e5421e36a0c9354cac12203074df6877c24abd274b81d589db4d95e1e"}
Oct 30 18:37:30.676496 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:30.676146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:31.157413 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.157382    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:31.158551 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.158514    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:31.300490 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.300425    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-hqx6v" podStartSLOduration=3.01984882 podStartE2EDuration="12.30041073s" totalImagesPullingTime="9.28056191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:30.840861616 +0000 UTC m=+12.996269196" watchObservedRunningTime="2026-10-30 18:37:31.30041073 +0000 UTC m=+13.455818308"
Oct 30 18:37:31.438318 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.437882    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:31.438318 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:31.438024    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:31.581729 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.581669    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj" event={"ID":"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5","Type":"ContainerStarted","Data":"a51cb01594dcf516a05eafb9490338b97f4a5dd5bd5b8783aca943175b7c4507"}
Oct 30 18:37:31.585547 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.585522    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fckwv" event={"ID":"e7473358-5d80-4235-9f4f-f72c00a84d55","Type":"ContainerStarted","Data":"ac896d66e9e94a5eda9c6d4609e5d86239189db6d582fc3d20e595c97adfb566"}
Oct 30 18:37:31.710373 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:31.710290    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj" podStartSLOduration=2.311140352 podStartE2EDuration="12.710275316s" totalImagesPullingTime="10.399134964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:31.708070365 +0000 UTC m=+13.863477938" watchObservedRunningTime="2026-10-30 18:37:31.710275316 +0000 UTC m=+13.865682890"
Oct 30 18:37:32.437639 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.437611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:32.437756 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:32.437736    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:32.437800 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.437779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:32.437890 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:32.437873    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:32.588648 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.588610    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l7ln5" event={"ID":"764ba139-faa5-4431-b64e-d3e0d2866470","Type":"ContainerStarted","Data":"f602612ffd0a2abd29f9d68626a032b38ddba5957fbddddc1bf256f37a170c9e"}
Oct 30 18:37:32.590943 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.590911    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="4acc81569bff9238449c8ee8242f2f8efd717c04eda771ae0929dfec2d743914" exitCode=0
Oct 30 18:37:32.591066 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.590955    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerDied","Data":"4acc81569bff9238449c8ee8242f2f8efd717c04eda771ae0929dfec2d743914"}
Oct 30 18:37:32.709865 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.709819    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fckwv" podStartSLOduration=3.854679367 podStartE2EDuration="12.709802226s" totalImagesPullingTime="8.855122859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:31.826641706 +0000 UTC m=+13.982049283" watchObservedRunningTime="2026-10-30 18:37:32.709802226 +0000 UTC m=+14.865209801"
Oct 30 18:37:32.710477 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:32.710447    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l7ln5" podStartSLOduration=2.530780741 podStartE2EDuration="13.710435656s" totalImagesPullingTime="11.179654915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:32.709625583 +0000 UTC m=+14.865033158" watchObservedRunningTime="2026-10-30 18:37:32.710435656 +0000 UTC m=+14.865843233"
Oct 30 18:37:33.278790 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:33.278751    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:33.437882 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:33.437848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:33.438049 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:33.437961    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:33.543965 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:33.543835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:34.334692 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.334662    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:34.438114 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.437869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:34.438251 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.437906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:34.438251 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:34.438178    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:34.438338 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:34.438284    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:34.567674 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.567626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:34.597642 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.597615    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="3b006c49e3b3da9f59c741530c8c0ffe419f2450ed5aa9c24a2c5e3b46f6e99d" exitCode=0
Oct 30 18:37:34.597775 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.597655    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerDied","Data":"3b006c49e3b3da9f59c741530c8c0ffe419f2450ed5aa9c24a2c5e3b46f6e99d"}
Oct 30 18:37:34.829775 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:34.829739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:35.105503 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:35.105369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:35.437590 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:35.437520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:35.438053 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:35.437635    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:35.623668 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:35.623632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:35.848410 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:35.848370    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:36.211436 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:36.211368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:36.211436 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:36.211428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:36.211624 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.211507    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:36.211624 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.211525    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:36.211624 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.211555    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:37:52.211543094 +0000 UTC m=+34.366950646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:36.211624 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.211583    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:52.211565224 +0000 UTC m=+34.366972791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:36.312517 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:36.312486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:36.312660 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.312625    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:36.312660 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.312643    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:36.312660 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.312655    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:36.312797 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.312715    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:37:52.312700608 +0000 UTC m=+34.468108160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:36.437989 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:36.437956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:36.438403 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:36.437995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:36.438403 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.438100    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:36.438403 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:36.438242    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:36.724742 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:36.724720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:37.437333 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.437134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:37.437494 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:37.437407    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:37.606772 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.606743    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="cb6ae6e6f05296ab9e216e46be3d4a576052eed4ae537f827c4fb360b8498586" exitCode=0
Oct 30 18:37:37.607243 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.606822    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerDied","Data":"cb6ae6e6f05296ab9e216e46be3d4a576052eed4ae537f827c4fb360b8498586"}
Oct 30 18:37:37.610117 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.610099    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"7b4f29fd17b716700c22149adad3bbfd500eda01ce925caf187db081e9885698"}
Oct 30 18:37:37.610207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.610158    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"95353f7b9db116addf13f1f0cd9eef74b785f18f1b7ca21488f8a9788d4f8aa2"}
Oct 30 18:37:37.610207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.610190    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"519e0e55d0138f3c0ec128890c90d5f221533595a0cf6e8ec2c79e49beae695a"}
Oct 30 18:37:37.610312 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.610237    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"3a10d53045746a070000789dc0444550e01d40641ec0cd5429c204a868a5a616"}
Oct 30 18:37:37.610312 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.610269    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"6be5a7c841dfac4673721827e49c3b1f4766d249cebd148ed3984b122989ba72"}
Oct 30 18:37:37.610312 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.610302    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"2dc629d636187e4414f52c27d7e64aca450d19a2df49052f81a73c04964e015e"}
Oct 30 18:37:37.664928 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.664903    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:37.672035 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.672016    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:37.672155 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.672138    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 18:37:37.672564 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:37.672545    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:37:38.068097 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.068067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:38.293884 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.293858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:38.438754 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.438684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:38.438884 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:38.438775    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:38.438884 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.438854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:38.438966 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:38.438949    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:38.575916 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.575883    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:38.614598 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.614575    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="47d06fda8b635ccc52f320dc9b05633665e459e06d4edd3f69570af80a052b7f" exitCode=0
Oct 30 18:37:38.615131 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:38.614603    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerDied","Data":"47d06fda8b635ccc52f320dc9b05633665e459e06d4edd3f69570af80a052b7f"}
Oct 30 18:37:39.437652 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:39.437627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:39.437822 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:39.437717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:39.606991 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:39.606953    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:39.620327 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:39.620301    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" event={"ID":"aa1148f4-6adb-46ec-96c8-d33ca9883fbd","Type":"ContainerStarted","Data":"0b4d5ca1d683d275c57f79b2c831a712fea81f17c03ce15a4135430ffa99ce52"}
Oct 30 18:37:39.623180 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:39.623158    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"fcda5b5e5d0e2c96dcfc1af2ea36da0743c4953c296af80b215268f67965fcd1"}
Oct 30 18:37:39.758621 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:39.758548    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b2t2n" podStartSLOduration=7.255773054 podStartE2EDuration="20.758536364s" totalImagesPullingTime="13.50276331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:39.758124654 +0000 UTC m=+21.913532228" watchObservedRunningTime="2026-10-30 18:37:39.758536364 +0000 UTC m=+21.913943935"
Oct 30 18:37:39.966826 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:39.966792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:40.219044 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:40.219011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:40.432617 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:40.432588    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:40.437562 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:40.437542    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:40.437664 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:40.437648    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:40.437743 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:40.437729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:40.437837 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:40.437819    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:41.202508 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.202481    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hqx6v_db75277c-76a4-4127-b5c2-d6bead6f6db2/dns-node-resolver/0.log"
Oct 30 18:37:41.425859 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.425765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:41.437586 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.437553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:41.437683 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:41.437652    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:41.630820 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.630790    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" event={"ID":"9581611c-5430-475b-bd37-26c7e13b3fbd","Type":"ContainerStarted","Data":"ca8f7f3069bbd1594dbe63e322d4f2ed53ec14c6f647d845dc768928297287a4"}
Oct 30 18:37:41.631055 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.631037    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:41.631163 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.631095    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:41.632861 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.632837    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:41.646729 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.646578    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:41.863237 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.863204    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:41.922359 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:41.922316    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt" podStartSLOduration=6.048359605 podStartE2EDuration="21.922303713s" totalImagesPullingTime="15.873944108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:41.922007209 +0000 UTC m=+24.077414788" watchObservedRunningTime="2026-10-30 18:37:41.922303713 +0000 UTC m=+24.077711287"
Oct 30 18:37:42.087572 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.087545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:42.323722 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.323705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wn9rz_f7f00c4d-1310-4e08-ba66-d9720844b86f/node-ca/0.log"
Oct 30 18:37:42.350570 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.350536    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:42.438024 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.438003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:42.438137 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:42.438117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:42.438257 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.438214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:42.438372 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:42.438351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:42.574949 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.574885    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:42.632910 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.632889    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:42.647488 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.647469    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:37:42.916221 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:42.916139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:43.267488 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:43.267420    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:43.437097 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:43.437067    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:43.437456 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:43.437159    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:43.528528 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:43.528469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:43.876995 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:43.876969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:44.176753 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:44.176686    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:44.437805 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:44.437739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:44.438150 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:44.437855    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:44.438150 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:44.437909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:44.438150 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:44.438002    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:44.445297 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:44.445271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:45.119451 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:45.119404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:45.346398 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:45.346367    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:45.437920 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:45.437864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:45.438314 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:45.437951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:45.602890 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:45.602859    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:45.868318 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:45.868285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:46.082456 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:46.082434    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:46.304298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:46.304266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:46.437782 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:46.437750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:46.437937 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:46.437883    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:46.437937 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:46.437934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:46.438265 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:46.438014    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:46.562928 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:46.562858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:47.437047 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:47.437019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:47.437259 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:47.437109    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:47.594571 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:47.594541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:47.860862 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:47.860816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:48.165594 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:48.165504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:48.431091 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:48.431021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:48.438691 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:48.438663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:48.438808 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:48.438741    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:48.438808 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:48.438786    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:48.438889 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:48.438838    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:48.840051 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:48.840011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:49.437249 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:49.437203    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:49.437401 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:49.437310    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:50.167970 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:50.167936    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:50.437914 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:50.437845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:50.438045 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:50.437944    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:50.438045 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:50.437997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:50.438123 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:50.438088    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:50.666492 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:50.666465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:50.984435 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:50.984406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:51.437593 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:51.437562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:51.438043 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:51.437670    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:51.741029 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:51.740954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:51.992152 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:51.992088    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:52.224486 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:52.224457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:52.224650 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:52.224515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:52.224650 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.224603    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:52.224650 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.224614    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:52.224771 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.224655    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret podName:8c63e418-061c-4f79-9d26-28fe2adba2cc nodeName:}" failed. No retries permitted until 2026-10-30 18:38:24.224642936 +0000 UTC m=+66.380050488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret") pod "global-pull-secret-syncer-rq9kn" (UID: "8c63e418-061c-4f79-9d26-28fe2adba2cc") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:52.224771 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.224670    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs podName:5682428d-476a-4cd6-b4c4-a17675fea5f2 nodeName:}" failed. No retries permitted until 2026-10-30 18:38:24.224662631 +0000 UTC m=+66.380070184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs") pod "network-metrics-daemon-29tfr" (UID: "5682428d-476a-4cd6-b4c4-a17675fea5f2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:52.239267 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:52.239222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:52.325062 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:52.325039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:52.325165 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.325153    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:52.325204 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.325172    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:52.325204 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.325181    2577 projected.go:196] Error preparing data for projected volume kube-api-access-zmdz8 for pod openshift-network-diagnostics/network-check-target-pqztj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:52.325287 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.325247    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8 podName:1da3b8e1-4a93-4493-b96b-d1d057f48c1c nodeName:}" failed. No retries permitted until 2026-10-30 18:38:24.325218264 +0000 UTC m=+66.480625833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmdz8" (UniqueName: "kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8") pod "network-check-target-pqztj" (UID: "1da3b8e1-4a93-4493-b96b-d1d057f48c1c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:52.437523 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:52.437502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:52.437647 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:52.437547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:52.437647 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.437620    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:52.438022 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:52.437731    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:53.004726 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:53.004693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:53.229119 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:53.229093    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:53.437043 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:53.437019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:53.437192 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:53.437102    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:54.437323 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:54.437293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:54.437704 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:54.437333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:54.437704 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:54.437427    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:54.437704 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:54.437571    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:55.437362 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:55.437335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:55.437702 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:55.437421    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:56.437890 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:56.437856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:56.438319 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:56.438024    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:56.438319 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:56.438063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:56.438319 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:56.438154    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:57.437308 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:57.437279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:57.437454 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:57.437372    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:37:58.242302 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:58.242275    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:58.438032 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:58.438000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:37:58.438209 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:58.438078    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:37:58.438209 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:58.438154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:37:58.438356 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:58.438258    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:37:58.457855 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:58.457832    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:37:59.437088 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:37:59.437058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:37:59.437517 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:37:59.437148    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:38:00.281849 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:00.281811    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:00.437236 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:00.437194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:00.437236 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:00.437241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:00.437674 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:00.437333    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:38:00.437674 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:00.437452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:38:00.620065 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:00.620021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:00.899616 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:00.899547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:01.151818 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.151724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:01.375405 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.375374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:01.437598 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.437529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:01.438139 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:01.438101    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:38:01.953333 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.953306    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29tfr"]
Oct 30 18:38:01.953481 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.953430    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:01.953562 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:01.953542    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:38:01.953953 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.953932    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq9kn"]
Oct 30 18:38:01.954047 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.954025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:01.954140 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:01.954122    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:38:01.956484 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.956460    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqztj"]
Oct 30 18:38:01.956595 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:01.956552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:01.956664 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:01.956637    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:38:03.325457 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:03.325426    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:03.437213 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:03.437190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:03.437355 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:03.437279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:03.437355 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:03.437305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:03.437420 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:03.437386    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:38:03.437450 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:03.437431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:38:03.437519 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:03.437501    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:38:03.596178 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:03.596099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:03.827977 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:03.827949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:05.438022 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:05.437850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:05.438415 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:05.437899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:05.438415 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:05.438084    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqztj" podUID="1da3b8e1-4a93-4493-b96b-d1d057f48c1c"
Oct 30 18:38:05.438415 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:05.437911    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:05.438415 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:05.438169    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29tfr" podUID="5682428d-476a-4cd6-b4c4-a17675fea5f2"
Oct 30 18:38:05.438415 ip-10-0-133-244 kubenswrapper[2577]: E1030 18:38:05.438262    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9kn" podUID="8c63e418-061c-4f79-9d26-28fe2adba2cc"
Oct 30 18:38:05.913061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:05.913028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:07.128170 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.128147    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeReady"
Oct 30 18:38:07.128480 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.128253    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 18:38:07.321428 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.321409    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jlkk2"]
Oct 30 18:38:07.323417 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.323401    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7k2jl"]
Oct 30 18:38:07.323525 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.323511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.325523 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.325506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.353691 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.353672    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nk68x"]
Oct 30 18:38:07.358447 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.358073    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7k2jl"]
Oct 30 18:38:07.358773 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.358703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.361689 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.361664    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlkk2"]
Oct 30 18:38:07.387357 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387326    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 18:38:07.387453 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387397    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-m4f62\""
Oct 30 18:38:07.387453 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387407    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7kh4z\""
Oct 30 18:38:07.387453 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387410    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 18:38:07.387453 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387399    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 18:38:07.387453 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387438    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 18:38:07.387622 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.387465    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 18:38:07.414868 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.414849    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nk68x"]
Oct 30 18:38:07.427470 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.427450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cdddf29-8df1-457c-b881-e50bf4cd6898-metrics-tls\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.427530 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.427492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g92wd\" (UniqueName: \"kubernetes.io/projected/56cefe62-35cf-4953-937e-f46b87c1a928-kube-api-access-g92wd\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.427530 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.427514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cdddf29-8df1-457c-b881-e50bf4cd6898-config-volume\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.427631 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.427613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2xk8\" (UniqueName: \"kubernetes.io/projected/1cdddf29-8df1-457c-b881-e50bf4cd6898-kube-api-access-d2xk8\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.427664 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.427645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56cefe62-35cf-4953-937e-f46b87c1a928-cert\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.427691 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.427679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdddf29-8df1-457c-b881-e50bf4cd6898-tmp-dir\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.437535 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.437503    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:07.437605 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.437576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:07.437605 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.437599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:07.498728 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.498706    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 18:38:07.498844 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.498827    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 18:38:07.498901 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.498831    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 18:38:07.498901 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.498837    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f6d2v\""
Oct 30 18:38:07.499130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499113    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 18:38:07.499130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499120    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 18:38:07.499247 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499216    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 18:38:07.499395 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499383    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsdbf\""
Oct 30 18:38:07.499545 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499532    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w4fd8\""
Oct 30 18:38:07.499609 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499583    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-smcdv\""
Oct 30 18:38:07.499647 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.499620    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 18:38:07.506512 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.506499    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 18:38:07.528099 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20b4f4-576f-4153-925a-3441a17d73d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.528141 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56cefe62-35cf-4953-937e-f46b87c1a928-cert\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.528176 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdddf29-8df1-457c-b881-e50bf4cd6898-tmp-dir\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.528264 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20b4f4-576f-4153-925a-3441a17d73d9-crio-socket\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.528342 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20b4f4-576f-4153-925a-3441a17d73d9-data-volume\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.528398 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.528451 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cdddf29-8df1-457c-b881-e50bf4cd6898-metrics-tls\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.528525 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4d4w\" (UniqueName: \"kubernetes.io/projected/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-api-access-z4d4w\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.528568 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528520    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdddf29-8df1-457c-b881-e50bf4cd6898-tmp-dir\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.528568 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92wd\" (UniqueName: \"kubernetes.io/projected/56cefe62-35cf-4953-937e-f46b87c1a928-kube-api-access-g92wd\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.528653 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cdddf29-8df1-457c-b881-e50bf4cd6898-config-volume\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.528653 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.528621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2xk8\" (UniqueName: \"kubernetes.io/projected/1cdddf29-8df1-457c-b881-e50bf4cd6898-kube-api-access-d2xk8\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.529058 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.529039    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cdddf29-8df1-457c-b881-e50bf4cd6898-config-volume\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.531994 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.531974    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cdddf29-8df1-457c-b881-e50bf4cd6898-metrics-tls\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.532069 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.532012    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56cefe62-35cf-4953-937e-f46b87c1a928-cert\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.602097 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.602048    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92wd\" (UniqueName: \"kubernetes.io/projected/56cefe62-35cf-4953-937e-f46b87c1a928-kube-api-access-g92wd\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.603899 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.603879    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2xk8\" (UniqueName: \"kubernetes.io/projected/1cdddf29-8df1-457c-b881-e50bf4cd6898-kube-api-access-d2xk8\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.629434 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20b4f4-576f-4153-925a-3441a17d73d9-crio-socket\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629519 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20b4f4-576f-4153-925a-3441a17d73d9-data-volume\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629519 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629596 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4d4w\" (UniqueName: \"kubernetes.io/projected/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-api-access-z4d4w\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629596 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20b4f4-576f-4153-925a-3441a17d73d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629686 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629592    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20b4f4-576f-4153-925a-3441a17d73d9-crio-socket\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629896 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629875    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20b4f4-576f-4153-925a-3441a17d73d9-data-volume\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.629965 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.629927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.631496 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.631476    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20b4f4-576f-4153-925a-3441a17d73d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.635440 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.635423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:07.641134 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.641112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:07.692850 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.692817    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4d4w\" (UniqueName: \"kubernetes.io/projected/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-api-access-z4d4w\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:07.792876 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.792845    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:07.972078 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:07.972014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:08.028795 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.028771    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlkk2"]
Oct 30 18:38:08.075306 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.075124    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7k2jl"]
Oct 30 18:38:08.075306 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:08.075267    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdddf29_8df1_457c_b881_e50bf4cd6898.slice/crio-7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3 WatchSource:0}: Error finding container 7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3: Status 404 returned error can't find the container with id 7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3
Oct 30 18:38:08.080847 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.080815    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:08.352921 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:08.352901    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a20b4f4_576f_4153_925a_3441a17d73d9.slice/crio-0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018 WatchSource:0}: Error finding container 0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018: Status 404 returned error can't find the container with id 0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018
Oct 30 18:38:08.353710 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.353687    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nk68x"]
Oct 30 18:38:08.685696 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.685604    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk68x" event={"ID":"4a20b4f4-576f-4153-925a-3441a17d73d9","Type":"ContainerStarted","Data":"9645fd8fc442c3eb541fe5c6a3acaf69d53e02979f42015e0e5429d5e03f7f86"}
Oct 30 18:38:08.685696 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.685654    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk68x" event={"ID":"4a20b4f4-576f-4153-925a-3441a17d73d9","Type":"ContainerStarted","Data":"0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018"}
Oct 30 18:38:08.686646 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.686623    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7k2jl" event={"ID":"1cdddf29-8df1-457c-b881-e50bf4cd6898","Type":"ContainerStarted","Data":"7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3"}
Oct 30 18:38:08.687705 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.687687    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlkk2" event={"ID":"56cefe62-35cf-4953-937e-f46b87c1a928","Type":"ContainerStarted","Data":"0f18bf9b55c4395670e16730fbcebea3f621da30e09d10ffe23fd3708e91d073"}
Oct 30 18:38:08.904394 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:08.904371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:09.310253 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:09.310208    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:09.678420 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:09.678382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:09.990109 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:09.989982    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:10.337303 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.337280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:10.513208 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.513188    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"]
Oct 30 18:38:10.516498 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.516480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.586498 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.586438    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"]
Oct 30 18:38:10.586974 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.586951    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:38:10.586974 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.586965    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 18:38:10.587827 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.587794    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fqx94\""
Oct 30 18:38:10.588143 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.587963    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 18:38:10.588143 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.588046    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 18:38:10.588588 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.588570    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 18:38:10.619520 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.619483    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ztgh2"]
Oct 30 18:38:10.622096 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.622076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.635105 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.635083    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"]
Oct 30 18:38:10.638311 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.638291    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.656637 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.656610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.656818 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.656652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjxl\" (UniqueName: \"kubernetes.io/projected/6d02e71e-b1a9-4e13-85a2-92435ed108c6-kube-api-access-gkjxl\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.656818 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.656769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d02e71e-b1a9-4e13-85a2-92435ed108c6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.656930 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.656815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.666713 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.666683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:10.688598 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.688575    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 18:38:10.689693 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.689629    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 18:38:10.689835 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.689711    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-swgzb\""
Oct 30 18:38:10.690037 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.690015    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 18:38:10.695896 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.695859    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk68x" event={"ID":"4a20b4f4-576f-4153-925a-3441a17d73d9","Type":"ContainerStarted","Data":"e3889c58c19ce5cbf84b72cffbbc855b29a01dce1d5fdbf3a3254c65d08df02f"}
Oct 30 18:38:10.698118 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.698084    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7k2jl" event={"ID":"1cdddf29-8df1-457c-b881-e50bf4cd6898","Type":"ContainerStarted","Data":"d4c9f9391d486396c41b7265c164e0bd011b9fd9c439bdec2c614324a5a13c24"}
Oct 30 18:38:10.698205 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.698130    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7k2jl" event={"ID":"1cdddf29-8df1-457c-b881-e50bf4cd6898","Type":"ContainerStarted","Data":"362187b4cdbde2bb2006642556715a580914a9cd2204311b188316073607cb59"}
Oct 30 18:38:10.698292 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.698267    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:10.706690 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.706669    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"]
Oct 30 18:38:10.735450 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.735426    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:38:10.735573 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.735493    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 18:38:10.735573 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.735565    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sr9st\""
Oct 30 18:38:10.757735 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.757865 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-sys\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.757865 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-textfile\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.757865 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-root\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.757865 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-tls\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.757865 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757907    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-wtmp\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.757996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6t9\" (UniqueName: \"kubernetes.io/projected/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-api-access-bh6t9\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.758061 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d02e71e-b1a9-4e13-85a2-92435ed108c6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.758384 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.758384 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-metrics-client-ca\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.758384 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.758384 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mnwh\" (UniqueName: \"kubernetes.io/projected/fd305194-b939-401e-a5d0-b0f38e8aae86-kube-api-access-2mnwh\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.758384 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjxl\" (UniqueName: \"kubernetes.io/projected/6d02e71e-b1a9-4e13-85a2-92435ed108c6-kube-api-access-gkjxl\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.758384 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.758265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.759682 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.759663    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d02e71e-b1a9-4e13-85a2-92435ed108c6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.762720 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.762677    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.773851 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.773830    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.794000 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.793979    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 18:38:10.826996 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.826975    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjxl\" (UniqueName: \"kubernetes.io/projected/6d02e71e-b1a9-4e13-85a2-92435ed108c6-kube-api-access-gkjxl\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.830666 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.830645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:10.859052 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859159 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-wtmp\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859159 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859159 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6t9\" (UniqueName: \"kubernetes.io/projected/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-api-access-bh6t9\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.859344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.859344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.859344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-metrics-client-ca\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.859344 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwh\" (UniqueName: \"kubernetes.io/projected/fd305194-b939-401e-a5d0-b0f38e8aae86-kube-api-access-2mnwh\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859576 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.859576 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.859576 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-sys\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859576 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-textfile\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859576 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859537    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-root\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.859576 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.859567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-tls\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.860703 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.860677    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.862286 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.861175    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-wtmp\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.862286 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.861653    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.862286 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862037    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-metrics-client-ca\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.862286 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862052    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.862924 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862583    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.862924 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862770    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.862924 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862770    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-textfile\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.862924 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862816    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-sys\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.862924 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.862859    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-root\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.864194 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.864165    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.864367 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.864350    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-tls\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.864744 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.864707    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.937439 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.937201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:10.939956 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.939928    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6t9\" (UniqueName: \"kubernetes.io/projected/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-api-access-bh6t9\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:10.940243 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.940211    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnwh\" (UniqueName: \"kubernetes.io/projected/fd305194-b939-401e-a5d0-b0f38e8aae86-kube-api-access-2mnwh\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:10.953824 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:10.953804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:11.080880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.080826    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-7k2jl" podStartSLOduration=1.834761217 podStartE2EDuration="4.080805518s" totalImagesPullingTime="2.246044301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:11.079599926 +0000 UTC m=+53.235007502" watchObservedRunningTime="2026-10-30 18:38:11.080805518 +0000 UTC m=+53.236213093"
Oct 30 18:38:11.238834 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.238766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:11.254398 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:11.254369    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd305194_b939_401e_a5d0_b0f38e8aae86.slice/crio-0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb WatchSource:0}: Error finding container 0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb: Status 404 returned error can't find the container with id 0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb
Oct 30 18:38:11.272633 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.272609    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"]
Oct 30 18:38:11.273200 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:11.273177    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d02e71e_b1a9_4e13_85a2_92435ed108c6.slice/crio-7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f WatchSource:0}: Error finding container 7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f: Status 404 returned error can't find the container with id 7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f
Oct 30 18:38:11.339856 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.339758    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"]
Oct 30 18:38:11.361244 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:11.357933    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8a5d1c_491a_4031_86cc_d5fbe2d07f62.slice/crio-075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689 WatchSource:0}: Error finding container 075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689: Status 404 returned error can't find the container with id 075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689
Oct 30 18:38:11.437629 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.437549    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:11.690714 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.690691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:11.707153 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.707109    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlkk2" event={"ID":"56cefe62-35cf-4953-937e-f46b87c1a928","Type":"ContainerStarted","Data":"5447456189bb7e483d2422ff8c757deb1a4f917200cdc7933fa9a827c6a94030"}
Oct 30 18:38:11.708307 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.708284    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztgh2" event={"ID":"fd305194-b939-401e-a5d0-b0f38e8aae86","Type":"ContainerStarted","Data":"0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb"}
Oct 30 18:38:11.709590 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.709565    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l" event={"ID":"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62","Type":"ContainerStarted","Data":"075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689"}
Oct 30 18:38:11.711441 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.711422    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp" event={"ID":"6d02e71e-b1a9-4e13-85a2-92435ed108c6","Type":"ContainerStarted","Data":"726a68e7a132b9ca3355a8bd2eede92cfe6a43efc8ca693c518eff51158c12fc"}
Oct 30 18:38:11.711536 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.711461    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp" event={"ID":"6d02e71e-b1a9-4e13-85a2-92435ed108c6","Type":"ContainerStarted","Data":"9d185cac9e77ced526675549104e625fd69ce0a4b79e020e635f5d9bdd473cb1"}
Oct 30 18:38:11.711536 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.711485    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp" event={"ID":"6d02e71e-b1a9-4e13-85a2-92435ed108c6","Type":"ContainerStarted","Data":"7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f"}
Oct 30 18:38:11.831570 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.831529    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jlkk2" podStartSLOduration=1.59936114 podStartE2EDuration="4.831518344s" totalImagesPullingTime="3.232157204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:11.831152939 +0000 UTC m=+53.986560513" watchObservedRunningTime="2026-10-30 18:38:11.831518344 +0000 UTC m=+53.986925909"
Oct 30 18:38:11.912901 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:11.912811    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:12.146743 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.146706    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:12.718835 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.718808    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk68x" event={"ID":"4a20b4f4-576f-4153-925a-3441a17d73d9","Type":"ContainerStarted","Data":"84a7cda2522e0120300c8143bdd55a50b07f01c24aae74951f8538f411153aa8"}
Oct 30 18:38:12.738307 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.738279    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:12.742983 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.742963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.751613 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.751574    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-volume\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-out\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w46fk\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-kube-api-access-w46fk\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-tls-assets\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-web-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.776880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.775800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.804157 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804133    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 18:38:12.804354 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804330    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 18:38:12.804424 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804365    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 18:38:12.804424 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804389    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 18:38:12.804526 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804461    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 18:38:12.804526 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804504    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kt2wj\""
Oct 30 18:38:12.804620 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804527    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 18:38:12.804620 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.804548    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 18:38:12.843694 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.843668    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:12.876956 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.876924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-web-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877139 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877213 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877213 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-volume\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877330 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-out\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877382 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877382 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w46fk\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-kube-api-access-w46fk\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877462 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877506 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877548 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877640 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.877640 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.877602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-tls-assets\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.878543 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.878507    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.878796 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.878776    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.881557 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.881528    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-tls-assets\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.881997 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.881953    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.883045 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.883024    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-out\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.883134 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.883117    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-volume\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.883515 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.883476    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-web-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.883515 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.883483    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.884835 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.884814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.884920 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.884862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.904588 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.904551    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 18:38:12.905218 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.905194    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 18:38:12.905677 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.905630    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nk68x" podStartSLOduration=2.7746604980000003 podStartE2EDuration="5.905614837s" totalImagesPullingTime="3.130954339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:38:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:12.9044947 +0000 UTC m=+55.059902265" watchObservedRunningTime="2026-10-30 18:38:12.905614837 +0000 UTC m=+55.061022414"
Oct 30 18:38:12.908416 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.908217    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.909444 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.909423    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:12.943298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:12.943248    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w46fk\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-kube-api-access-w46fk\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:13.063298 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.063271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:13.499617 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:13.499390    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77141143_0ae3_4a7d_ba64_9bab0c3bf939.slice/crio-a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0 WatchSource:0}: Error finding container a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0: Status 404 returned error can't find the container with id a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0
Oct 30 18:38:13.500979 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.500955    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:13.724585 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.724545    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp" event={"ID":"6d02e71e-b1a9-4e13-85a2-92435ed108c6","Type":"ContainerStarted","Data":"3fe377e435b65e33f256ea0af04ac21611576f77c196b77d8b29120053f7d670"}
Oct 30 18:38:13.726195 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.726164    2577 generic.go:356] "Generic (PLEG): container finished" podID="fd305194-b939-401e-a5d0-b0f38e8aae86" containerID="25ef1cdcc2bb39eeb73fc6e1d3db187c026079f2c912cc28322475f99af945d1" exitCode=0
Oct 30 18:38:13.726334 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.726211    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztgh2" event={"ID":"fd305194-b939-401e-a5d0-b0f38e8aae86","Type":"ContainerDied","Data":"25ef1cdcc2bb39eeb73fc6e1d3db187c026079f2c912cc28322475f99af945d1"}
Oct 30 18:38:13.728362 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.728338    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l" event={"ID":"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62","Type":"ContainerStarted","Data":"236c16c91fb3249fe39e37ef03fb94d9d9bc09a1ae652c7fa7dced8d3d0940a3"}
Oct 30 18:38:13.728500 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.728383    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l" event={"ID":"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62","Type":"ContainerStarted","Data":"766dd2ec99c24dc63a9b019ce922e9798c4546654f883df8f1d9aac5e0edcaa1"}
Oct 30 18:38:13.728500 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.728433    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l" event={"ID":"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62","Type":"ContainerStarted","Data":"dd68453e6dabc12dbcce9fdb4b9b3fe671f768c2378fa7ffd973af8d01492774"}
Oct 30 18:38:13.729704 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.729677    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0"}
Oct 30 18:38:13.872888 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:13.872841    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp" podStartSLOduration=2.284813122 podStartE2EDuration="3.872827577s" totalImagesPullingTime="1.588014455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:13.871637725 +0000 UTC m=+56.027045299" watchObservedRunningTime="2026-10-30 18:38:13.872827577 +0000 UTC m=+56.028235145"
Oct 30 18:38:14.050995 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:14.050903    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l" podStartSLOduration=2.160107408 podStartE2EDuration="4.050888936s" totalImagesPullingTime="1.890781528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:14.050453209 +0000 UTC m=+56.205860783" watchObservedRunningTime="2026-10-30 18:38:14.050888936 +0000 UTC m=+56.206296500"
Oct 30 18:38:14.648008 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:14.647981    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:14.736074 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:14.736030    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztgh2" event={"ID":"fd305194-b939-401e-a5d0-b0f38e8aae86","Type":"ContainerStarted","Data":"eafa8a9101970ee5a7869ab1d591a06c2f14c964cfe8ef6c0f6d20f758814fca"}
Oct 30 18:38:14.736643 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:14.736092    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztgh2" event={"ID":"fd305194-b939-401e-a5d0-b0f38e8aae86","Type":"ContainerStarted","Data":"6f8c66c55101dd4f1e7174dfaff2b8ec26fde3a05fe5ebce851c72d1069a5fb0"}
Oct 30 18:38:14.881082 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:14.881038    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:14.936493 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:14.936389    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ztgh2" podStartSLOduration=3.420718577 podStartE2EDuration="4.936373397s" totalImagesPullingTime="1.435075955s" totalInitContainerRuntime="80.578865ms" isStatefulPod=true podCreationTimestamp="2026-10-30 18:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:14.935889535 +0000 UTC m=+57.091297110" watchObservedRunningTime="2026-10-30 18:38:14.936373397 +0000 UTC m=+57.091780973"
Oct 30 18:38:15.136236 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.136208    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:15.355903 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.355879    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:15.741037 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.740962    2577 generic.go:356] "Generic (PLEG): container finished" podID="77141143-0ae3-4a7d-ba64-9bab0c3bf939" containerID="b286d6b29b8e91c4da40077c02395b8bc07e49cf1087a6bd03a23d250f86ed17" exitCode=0
Oct 30 18:38:15.741459 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.741044    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerDied","Data":"b286d6b29b8e91c4da40077c02395b8bc07e49cf1087a6bd03a23d250f86ed17"}
Oct 30 18:38:15.768210 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.768183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:15.980377 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.980351    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:15.989507 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.989483    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c898556f7-rxxgm"]
Oct 30 18:38:15.991709 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:15.991671    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004081 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-client-certs\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004169 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-tls\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004207 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-client-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004253 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004293 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk9gn\" (UniqueName: \"kubernetes.io/projected/b369e7ad-ff3d-4a1e-9031-906027c85d2a-kube-api-access-wk9gn\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004353 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b369e7ad-ff3d-4a1e-9031-906027c85d2a-audit-log\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.004385 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.004362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-metrics-server-audit-profiles\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.049039 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.049018    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 18:38:16.049158 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.049058    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 18:38:16.049326 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.049301    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 18:38:16.049775 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.049757    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2wwxj\""
Oct 30 18:38:16.049880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.049834    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 18:38:16.049880 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.049848    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f25127kp2dcvt\""
Oct 30 18:38:16.054196 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.054168    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c898556f7-rxxgm"]
Oct 30 18:38:16.104874 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.104854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-client-certs\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.104975 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.104908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-tls\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105026 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.104974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-client-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105026 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.104992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.105025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9gn\" (UniqueName: \"kubernetes.io/projected/b369e7ad-ff3d-4a1e-9031-906027c85d2a-kube-api-access-wk9gn\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.105071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b369e7ad-ff3d-4a1e-9031-906027c85d2a-audit-log\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105120 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.105107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-metrics-server-audit-profiles\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105500 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.105477    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b369e7ad-ff3d-4a1e-9031-906027c85d2a-audit-log\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.105756 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.105737    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.106206 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.106181    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-metrics-server-audit-profiles\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.107581 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.107556    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-client-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.107662 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.107599    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-tls\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.107766 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.107747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-client-certs\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.168772 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.168749    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9gn\" (UniqueName: \"kubernetes.io/projected/b369e7ad-ff3d-4a1e-9031-906027c85d2a-kube-api-access-wk9gn\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.224080 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.224052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:16.302116 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.302043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:16.469348 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.469312    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:16.720015 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:16.719980    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb369e7ad_ff3d_4a1e_9031_906027c85d2a.slice/crio-05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8 WatchSource:0}: Error finding container 05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8: Status 404 returned error can't find the container with id 05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8
Oct 30 18:38:16.721304 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.721278    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c898556f7-rxxgm"]
Oct 30 18:38:16.745295 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:16.745265    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c898556f7-rxxgm" event={"ID":"b369e7ad-ff3d-4a1e-9031-906027c85d2a","Type":"ContainerStarted","Data":"05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8"}
Oct 30 18:38:17.759660 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:17.759633    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"6144de040cc63f407ba909d06c9453dbf652f79fd45ea2138f93b84410399a48"}
Oct 30 18:38:17.760015 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:17.759715    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"816e43f95a728a7ecd112e37ec3fbfaa1f0d9b9dc3f1e50e8b16e53ca2d0ffed"}
Oct 30 18:38:17.760015 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:17.759746    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"53a81fdf5ef0f9de51c19d01e549ce6266fcfb7091ac4d2b952d3be0b0c259fa"}
Oct 30 18:38:17.859386 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:17.859356    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:18.101352 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:18.101324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:18.771559 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:18.771480    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"1e70737003af44ce2271b02b8a52d756e4a6820b01a3363f7158223fd2b942fc"}
Oct 30 18:38:18.772089 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:18.772057    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"7ecd4580b9c153712b8d79eb4a5b47a62c3252a138d4bf066e143553819a810d"}
Oct 30 18:38:18.773737 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:18.773705    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c898556f7-rxxgm" event={"ID":"b369e7ad-ff3d-4a1e-9031-906027c85d2a","Type":"ContainerStarted","Data":"36e12976f70d6b6d6ca20e0a003d1a4c3d57d4e3fe11a7df344b6d2e5ccc7ff7"}
Oct 30 18:38:18.934059 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:18.934018    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c898556f7-rxxgm" podStartSLOduration=2.19178182 podStartE2EDuration="3.934004996s" totalImagesPullingTime="1.742223176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:18.932468204 +0000 UTC m=+61.087875778" watchObservedRunningTime="2026-10-30 18:38:18.934004996 +0000 UTC m=+61.089412570"
Oct 30 18:38:19.780162 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:19.780124    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"77141143-0ae3-4a7d-ba64-9bab0c3bf939","Type":"ContainerStarted","Data":"7f015136a990607c2e7774957e04d67e95e5fa42b1083b9d37354b9529864b11"}
Oct 30 18:38:20.074756 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.074710    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.667648584 podStartE2EDuration="8.074692879s" totalImagesPullingTime="4.39504784s" totalInitContainerRuntime="11.996455ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:20.023794389 +0000 UTC m=+62.179201963" watchObservedRunningTime="2026-10-30 18:38:20.074692879 +0000 UTC m=+62.230100455"
Oct 30 18:38:20.517068 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.516984    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:20.713778 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.713749    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:20.722396 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.722371    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:20.725440 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.725421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.818455 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.818433    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:20.830602 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.830584    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 18:38:20.830700 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.830604    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 18:38:20.830700 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.830652    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5mui169d0e6fr\""
Oct 30 18:38:20.830700 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.830668    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 18:38:20.831101 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.831081    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 18:38:20.831215 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.831088    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 18:38:20.831323 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.831118    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 18:38:20.831323 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.831138    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 18:38:20.831323 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.831177    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 18:38:20.840407 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.840460 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840415    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9fk5\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-kube-api-access-m9fk5\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.840460 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.840460 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.840722 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.840800 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.840836 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841001 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.840984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841090 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841133 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841192 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841260 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841260 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841330 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841393 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841517 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841549 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841640 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841640 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.841742 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.841700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.866818 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.866797    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 18:38:20.866818 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.866811    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 18:38:20.866947 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.866846    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 18:38:20.867054 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.867040    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-78hmw\""
Oct 30 18:38:20.867124 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.867064    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 18:38:20.913131 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.913095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:20.931188 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.931165    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 18:38:20.931188 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.931169    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 18:38:20.942030 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942130 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942332 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942332 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942332 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942332 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9fk5\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-kube-api-access-m9fk5\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942738    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.942831 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.942826    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.943161 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.943010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.943444 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.943420    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.944732 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.944699    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.945584 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.945565    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.945703 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.945680    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.945835 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.945807    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.946140 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.946113    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.946424 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.946398    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.946509 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.946406    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.947306 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.947286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.947446 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.947424    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.947516 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.947426    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.947637 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.947615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.947735 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.947717    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.947830 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.947815    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.948162 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.948145    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:20.949498 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:20.949482    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:21.008702 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:21.008676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9fk5\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-kube-api-access-m9fk5\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:21.044101 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:21.044077    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:21.473576 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:21.473545    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc0656d_bf19_4ed8_a70c_e44afb11dea5.slice/crio-c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17 WatchSource:0}: Error finding container c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17: Status 404 returned error can't find the container with id c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17
Oct 30 18:38:21.475326 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:21.475300    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:21.788441 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:21.788363    2577 generic.go:356] "Generic (PLEG): container finished" podID="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" containerID="98351f25ef81a0c5770fbc59b248c6e524c6910cc80462370eeeefe4290aa66d" exitCode=0
Oct 30 18:38:21.788570 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:21.788446    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerDied","Data":"98351f25ef81a0c5770fbc59b248c6e524c6910cc80462370eeeefe4290aa66d"}
Oct 30 18:38:21.788570 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:21.788539    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17"}
Oct 30 18:38:22.266662 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:22.266625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:22.522106 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:22.522035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:23.110449 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:23.110404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:23.362983 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:23.362898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:23.581788 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:23.581753    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:24.271195 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.271161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:24.271398 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.271285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:24.372289 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.372258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:24.373394 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.373350    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 18:38:24.373546 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.373394    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 18:38:24.384122 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.384097    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:24.384122 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.384110    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:24.423986 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.423964    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 18:38:24.484635 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.484610    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 18:38:24.496289 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.496261    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:24.588656 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.588625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:24.600746 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.600721    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w4fd8\""
Oct 30 18:38:24.604799 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.604780    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsdbf\""
Oct 30 18:38:24.609768 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.609750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:24.610100 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.610076    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-smcdv\""
Oct 30 18:38:24.613531 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.613514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:24.619681 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.619527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:24.856049 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:24.855968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:25.019967 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:25.019930    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da3b8e1_4a93_4493_b96b_d1d057f48c1c.slice/crio-0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc WatchSource:0}: Error finding container 0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc: Status 404 returned error can't find the container with id 0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc
Oct 30 18:38:25.020724 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.020699    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqztj"]
Oct 30 18:38:25.069214 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:25.069187    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5682428d_476a_4cd6_b4c4_a17675fea5f2.slice/crio-f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d WatchSource:0}: Error finding container f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d: Status 404 returned error can't find the container with id f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d
Oct 30 18:38:25.071633 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.071608    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29tfr"]
Oct 30 18:38:25.077458 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.077436    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq9kn"]
Oct 30 18:38:25.086806 ip-10-0-133-244 kubenswrapper[2577]: W1030 18:38:25.086781    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c63e418_061c_4f79_9d26_28fe2adba2cc.slice/crio-c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d WatchSource:0}: Error finding container c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d: Status 404 returned error can't find the container with id c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d
Oct 30 18:38:25.806525 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.806486    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"142ef58149f8a6fa03f3e493d969e57b93ea63d9610b5778666e0d69b74b24a3"}
Oct 30 18:38:25.806938 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.806566    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"5fda076fcd4b2865812389fc56657bbb4baef2c188c88dc03c533a8b5d28fa61"}
Oct 30 18:38:25.807752 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.807727    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq9kn" event={"ID":"8c63e418-061c-4f79-9d26-28fe2adba2cc","Type":"ContainerStarted","Data":"c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d"}
Oct 30 18:38:25.808906 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.808884    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29tfr" event={"ID":"5682428d-476a-4cd6-b4c4-a17675fea5f2","Type":"ContainerStarted","Data":"f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d"}
Oct 30 18:38:25.809921 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:25.809901    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqztj" event={"ID":"1da3b8e1-4a93-4493-b96b-d1d057f48c1c","Type":"ContainerStarted","Data":"0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc"}
Oct 30 18:38:27.823326 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:27.823215    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29tfr" event={"ID":"5682428d-476a-4cd6-b4c4-a17675fea5f2","Type":"ContainerStarted","Data":"f12b1ecf8c6e81b9708da7f934b01d0093dbdc98642159d1697ec6b1bc4beee3"}
Oct 30 18:38:27.823326 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:27.823291    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29tfr" event={"ID":"5682428d-476a-4cd6-b4c4-a17675fea5f2","Type":"ContainerStarted","Data":"a22b691658355a85586e4ced0ede028884c6322e5ef0e98e4fe7d0c27588cb94"}
Oct 30 18:38:27.947539 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:27.947480    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-29tfr" podStartSLOduration=67.19723548 podStartE2EDuration="1m8.947465159s" totalImagesPullingTime="1.750229679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:27.946350718 +0000 UTC m=+70.101758293" watchObservedRunningTime="2026-10-30 18:38:27.947465159 +0000 UTC m=+70.102872734"
Oct 30 18:38:28.216125 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:28.216013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:28.615445 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:28.615408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:28.831454 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:28.831423    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"5543b2c3d5c3a0abaa8d91f39994d029410769a18c0992eed404f9760c93ef4a"}
Oct 30 18:38:28.831927 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:28.831502    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"8caf9da3f02a807d9bcefa3f7ab8b650889fa9808de7135cae4a957c2bd15bca"}
Oct 30 18:38:28.831927 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:28.831546    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"e2c1a853cd181910e8fc4c2446f6d3f7a1f48db661a74b2472396c52e87be3f1"}
Oct 30 18:38:28.831927 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:28.831590    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fdc0656d-bf19-4ed8-a70c-e44afb11dea5","Type":"ContainerStarted","Data":"75f1d94af6a52efec747dcd110b185bbb706cae1cc142aa39bb04fdb65eea68b"}
Oct 30 18:38:29.113328 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:29.113202    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.729613275 podStartE2EDuration="9.113189713s" totalImagesPullingTime="6.3664377s" totalInitContainerRuntime="17.138738ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:29.112842554 +0000 UTC m=+71.268250130" watchObservedRunningTime="2026-10-30 18:38:29.113189713 +0000 UTC m=+71.268597286"
Oct 30 18:38:29.837762 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:29.837726    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqztj" event={"ID":"1da3b8e1-4a93-4493-b96b-d1d057f48c1c","Type":"ContainerStarted","Data":"57879e3c5d6d1a07f9cda9dca025e79a71b3944fb3ec8f51a279a579bb6f8141"}
Oct 30 18:38:29.838112 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:29.837994    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:29.978706 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:29.978644    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pqztj" podStartSLOduration=65.729147474 podStartE2EDuration="1m9.978626372s" totalImagesPullingTime="4.249478898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:29.972286615 +0000 UTC m=+72.127694189" watchObservedRunningTime="2026-10-30 18:38:29.978626372 +0000 UTC m=+72.134033947"
Oct 30 18:38:30.331852 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:30.331820    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:30.847119 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:30.847009    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq9kn" event={"ID":"8c63e418-061c-4f79-9d26-28fe2adba2cc","Type":"ContainerStarted","Data":"e3149a409edf5709a67bd159c98a39ed28d7ca07ac9bc8c96690cd9489a5a697"}
Oct 30 18:38:30.864219 ip-10-0-133-244 kubenswrapper[2577]: I1030 18:38:30.864119    2577 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:38:30.864290 ip-10-0-133-244 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 18:38:30.877853 ip-10-0-133-244 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 18:38:30.878025 ip-10-0-133-244 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 18:38:30.878187 ip-10-0-133-244 systemd[1]: kubelet.service: Consumed 4.377s CPU time.
Oct 30 18:38:30.888818 ip-10-0-133-244 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 18:38:30.951593 ip-10-0-133-244 kubenswrapper[5652]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:38:30.951593 ip-10-0-133-244 kubenswrapper[5652]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 18:38:30.951593 ip-10-0-133-244 kubenswrapper[5652]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:38:30.951593 ip-10-0-133-244 kubenswrapper[5652]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:38:30.953728 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953646    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.953728 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953727    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.953728 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953730    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.953728 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953734    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953737    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953740    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953742    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953745    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953748    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953750    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953753    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953757    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953759    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953762    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953765    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953767    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953770    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953772    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953775    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953777    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953780    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953783    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953785    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.953869 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953788    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953791    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953794    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953796    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953802    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953805    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953808    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953810    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953813    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953816    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953819    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953822    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953825    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953828    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953830    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953833    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953835    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953838    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953841    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953843    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.954377 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953846    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953848    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953851    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953854    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953856    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953859    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953862    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953864    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953867    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953869    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953872    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953874    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953878    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953881    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953884    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953886    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953889    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953892    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953894    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.954903 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953897    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953899    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953902    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953905    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953908    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953911    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953913    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953916    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953919    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953922    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953924    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953927    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953931    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953934    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953937    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953939    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953942    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953946    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953948    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953951    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.955388 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953954    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953958    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953963    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953967    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953971    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953974    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953977    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953980    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953983    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953986    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953988    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953991    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953994    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953997    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.953999    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954002    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954005    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954008    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.955904 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954011    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954013    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954016    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954019    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954022    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954025    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954762    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954769    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954772    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954775    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954778    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954781    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954785    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954787    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954790    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954793    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954795    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954798    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954801    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.956526 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954805    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954807    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954810    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954813    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954815    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954818    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954820    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954824    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954827    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954830    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954833    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954835    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954838    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954841    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954844    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954848    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954852    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954855    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954858    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.957072 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954861    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954864    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954867    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954870    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954873    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954875    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954879    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954882    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954885    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954888    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954891    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954894    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954896    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954899    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954902    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954905    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954907    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954910    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954913    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954916    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.957603 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954919    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954921    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954924    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954926    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954929    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954931    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954935    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954938    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954941    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954943    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954946    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954948    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954951    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954954    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954956    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954959    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954962    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954965    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954968    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954971    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.958141 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954974    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954977    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954980    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954982    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954985    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954988    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954991    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954993    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954996    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.954999    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955001    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955004    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955006    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955009    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955011    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955014    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955016    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955019    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955021    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.958720 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955024    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955026    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955029    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955031    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955034    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955036    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955039    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955042    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955045    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955047    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955050    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955052    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955056    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955060    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955064    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955592    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955600    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955603    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955606    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955609    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.959165 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955612    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955614    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955617    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955620    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955622    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955625    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955627    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955630    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955633    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955636    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955638    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955641    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955643    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955646    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955649    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955652    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955655    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955657    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955660    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.959727 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955664    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955667    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955670    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955674    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955677    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955679    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955682    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955685    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955687    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955693    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955695    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955698    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955701    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955703    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955706    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955709    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955711    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955714    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955717    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955720    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.960219 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955722    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955725    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955727    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955730    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955732    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955735    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955738    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955741    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955744    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955747    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955749    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955752    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955755    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955757    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955760    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955763    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955765    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955768    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955770    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.960771 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955773    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955776    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955780    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955783    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955786    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955788    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955791    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955793    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955796    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955799    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955801    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955804    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955810    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955813    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955817    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955820    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955822    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955825    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955828    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.961323 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955830    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955833    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955835    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955838    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955841    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955844    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955847    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955849    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955852    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955855    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955858    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955860    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955863    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955866    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955868    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955875    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955879    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955883    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955887    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.961777 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955891    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955895    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955901    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955905    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.955909    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956012    5652 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956024    5652 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956034    5652 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956039    5652 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956044    5652 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956047    5652 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956052    5652 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956056    5652 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956060    5652 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956063    5652 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956066    5652 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956070    5652 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956073    5652 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956076    5652 flags.go:64] FLAG: --cgroup-root=""
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956079    5652 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956082    5652 flags.go:64] FLAG: --client-ca-file=""
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956085    5652 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956088    5652 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 18:38:30.962250 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956093    5652 flags.go:64] FLAG: --cluster-domain=""
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956096    5652 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956099    5652 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956102    5652 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956106    5652 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956111    5652 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956115    5652 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956118    5652 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956121    5652 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956124    5652 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956127    5652 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956130    5652 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956134    5652 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956137    5652 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956141    5652 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956147    5652 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956150    5652 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956153    5652 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956157    5652 flags.go:64] FLAG: --enable-server="true"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956160    5652 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956164    5652 flags.go:64] FLAG: --event-burst="100"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956167    5652 flags.go:64] FLAG: --event-qps="50"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956170    5652 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956173    5652 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 18:38:30.962814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956177    5652 flags.go:64] FLAG: --eviction-hard=""
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956182    5652 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956185    5652 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956188    5652 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956191    5652 flags.go:64] FLAG: --eviction-soft=""
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956194    5652 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956197    5652 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956200    5652 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956203    5652 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956206    5652 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956209    5652 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956212    5652 flags.go:64] FLAG: --feature-gates=""
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956217    5652 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956220    5652 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956237    5652 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956247    5652 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956250    5652 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956254    5652 flags.go:64] FLAG: --help="false"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956257    5652 flags.go:64] FLAG: --hostname-override="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956260    5652 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956263    5652 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956266    5652 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956270    5652 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 18:38:30.963439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956275    5652 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956278    5652 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956281    5652 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956284    5652 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956287    5652 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956290    5652 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956293    5652 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956296    5652 flags.go:64] FLAG: --kube-reserved=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956299    5652 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956303    5652 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956306    5652 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956309    5652 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956312    5652 flags.go:64] FLAG: --lock-file=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956314    5652 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956317    5652 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956320    5652 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956326    5652 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956329    5652 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956333    5652 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956335    5652 flags.go:64] FLAG: --logging-format="text"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956339    5652 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956342    5652 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956345    5652 flags.go:64] FLAG: --manifest-url=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956348    5652 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956352    5652 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 18:38:30.964388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956358    5652 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956364    5652 flags.go:64] FLAG: --max-pods="110"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956369    5652 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956373    5652 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956378    5652 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956383    5652 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956388    5652 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956394    5652 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956398    5652 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956408    5652 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956411    5652 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956415    5652 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956418    5652 flags.go:64] FLAG: --pod-cidr=""
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956421    5652 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956424    5652 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956427    5652 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956430    5652 flags.go:64] FLAG: --port="10250"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956433    5652 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956436    5652 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0e23fb8696a011ef5"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956439    5652 flags.go:64] FLAG: --qos-reserved=""
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956442    5652 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956446    5652 flags.go:64] FLAG: --register-node="true"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956449    5652 flags.go:64] FLAG: --register-with-taints=""
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956452    5652 flags.go:64] FLAG: --registry-burst="10"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956455    5652 flags.go:64] FLAG: --registry-qps="5"
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956458    5652 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 18:38:30.965028 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956462    5652 flags.go:64] FLAG: --reserved-memory=""
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956466    5652 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956469    5652 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956472    5652 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956475    5652 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956478    5652 flags.go:64] FLAG: --runonce="false"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956481    5652 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956484    5652 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956487    5652 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956490    5652 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956493    5652 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956497    5652 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956500    5652 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956504    5652 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956507    5652 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956510    5652 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956514    5652 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956517    5652 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956521    5652 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956524    5652 flags.go:64] FLAG: --system-cgroups=""
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956527    5652 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956533    5652 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956536    5652 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956539    5652 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956543    5652 flags.go:64] FLAG: --tls-min-version=""
Oct 30 18:38:30.965667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956546    5652 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956549    5652 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956552    5652 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956555    5652 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956558    5652 flags.go:64] FLAG: --v="2"
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956562    5652 flags.go:64] FLAG: --version="false"
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956568    5652 flags.go:64] FLAG: --vmodule=""
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956574    5652 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.956580    5652 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956725    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956731    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956736    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956741    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956745    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956750    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956755    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956759    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956764    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956768    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956772    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956779    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.966313 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956785    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956790    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956793    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956796    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956802    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956806    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956809    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956811    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956814    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956817    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956820    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956823    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956825    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956828    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956831    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956833    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956836    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956840    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956844    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.966809 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956847    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956850    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956853    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956855    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956858    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956861    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956863    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956866    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956869    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956872    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956875    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956877    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956881    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956884    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956887    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956890    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956893    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956896    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956899    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956902    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.967268 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956904    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956908    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956912    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956916    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956920    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956925    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956928    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956931    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956934    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956937    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956939    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956942    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956944    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956947    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956950    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956952    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956955    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956958    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956960    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956963    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.967794 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956966    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956969    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956971    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956974    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956978    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956981    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956984    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956986    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956989    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956993    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.956996    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957000    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957004    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957008    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957011    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957013    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957016    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957019    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957022    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957025    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.968397 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957027    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957030    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957032    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957035    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957038    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957040    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957043    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957045    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957048    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957050    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957053    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957055    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957058    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957060    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957063    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.957093    5652 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:38:30.969117 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957129    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957135    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957138    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957141    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957144    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957148    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957150    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957153    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957155    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957158    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957161    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957163    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957166    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957168    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957171    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957174    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957176    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957179    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957181    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.970039 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957184    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957186    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957189    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957192    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957195    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957197    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957200    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957202    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957205    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957207    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957210    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957213    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957216    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957219    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957221    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957241    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957243    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957246    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957250    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957253    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.970757 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957255    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957258    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957261    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957263    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957266    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957269    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957271    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957274    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957277    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957279    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957282    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957285    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957287    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957290    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957293    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957295    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957298    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957300    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957303    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.971368 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957306    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957309    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957312    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957314    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957318    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957324    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957329    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957334    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957338    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957341    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957344    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957348    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957351    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957353    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957356    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957358    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957361    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957365    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957368    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.971924 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957371    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957374    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957377    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957379    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957381    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957384    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957387    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957389    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957392    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957394    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957397    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957400    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957403    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957406    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957409    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957411    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957414    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957417    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957419    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957422    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.972472 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957425    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957428    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957431    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957433    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957437    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957440    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957443    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957446    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.957449    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.961887    5652 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.961901    5652 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.961918    5652 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.961923    5652 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.961991    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.961997    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962001    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962004    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962007    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962010    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962013    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.972966 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962016    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962019    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962021    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962025    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962027    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962030    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962033    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962036    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962039    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962042    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962044    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962047    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962050    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962053    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962056    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962064    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962067    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962069    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962072    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.973499 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962075    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962078    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962081    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962083    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962086    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962088    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962092    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962094    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962097    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962099    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962102    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962105    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962107    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962110    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962112    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962115    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962118    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962120    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962123    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962125    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.974029 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962128    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962131    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962133    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962137    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962141    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962144    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962147    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962150    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962152    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962160    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962163    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962166    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962169    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962172    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962174    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962177    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962180    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962182    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962185    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.974513 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962188    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962190    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962193    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962195    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962198    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962200    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962203    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962206    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962208    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962211    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962213    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962216    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962219    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962236    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962241    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962246    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962249    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962252    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962254    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962257    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.974972 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962260    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962263    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962266    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962276    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962279    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962281    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962284    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962287    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962289    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962292    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962295    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962297    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962301    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962305    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962309    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962311    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962314    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962317    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962319    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.975495 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962322    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962324    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.962352    5652 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962547    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962552    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962555    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962558    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962561    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962563    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962566    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962569    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962571    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962574    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962577    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962579    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962582    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.975960 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962584    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962593    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962596    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962599    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962602    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962604    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962607    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962609    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962611    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962614    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962617    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962619    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962622    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962625    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962627    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962630    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962632    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962635    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962640    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.976421 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962643    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962646    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962649    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962652    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962654    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962657    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962660    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962663    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962665    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962668    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962670    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962673    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962675    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962678    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962681    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962689    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962692    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962694    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962697    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962699    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.976875 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962702    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962704    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962707    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962710    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962714    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962718    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962721    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962723    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962726    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962729    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962731    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962735    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962738    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962741    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962744    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962746    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962749    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962751    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962754    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.977445 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962757    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962759    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962762    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962764    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962767    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962770    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962772    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962775    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962778    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962789    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962792    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962794    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962797    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962799    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962802    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962804    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962807    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962809    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962812    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962815    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.977897 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962817    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962820    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962823    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962826    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962831    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962835    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962838    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962840    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962843    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962846    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962848    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962851    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962853    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962856    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962859    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.962882    5652 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:38:30.978418 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962942    5652 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962946    5652 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962949    5652 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962952    5652 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962954    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962957    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962966    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962969    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962971    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962974    5652 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962977    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962979    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962982    5652 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962984    5652 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962987    5652 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962990    5652 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962992    5652 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962995    5652 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.962998    5652 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:38:30.978808 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963000    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963003    5652 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963006    5652 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963008    5652 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963011    5652 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963014    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963016    5652 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963019    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963021    5652 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963024    5652 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963026    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963032    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963035    5652 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963038    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963040    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963043    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963046    5652 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963048    5652 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963051    5652 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963053    5652 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:38:30.979277 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963061    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963064    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963067    5652 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963069    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963073    5652 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963076    5652 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963080    5652 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963082    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963085    5652 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963088    5652 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963090    5652 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963093    5652 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963096    5652 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963099    5652 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963102    5652 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963105    5652 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963108    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963110    5652 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963113    5652 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:38:30.979798 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963115    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963118    5652 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963120    5652 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963123    5652 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963125    5652 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963128    5652 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963130    5652 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963133    5652 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963136    5652 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963138    5652 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963141    5652 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963143    5652 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963146    5652 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963148    5652 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963156    5652 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963159    5652 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963161    5652 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963164    5652 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963166    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963169    5652 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:38:30.980259 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963172    5652 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963174    5652 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963177    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963180    5652 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963183    5652 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963186    5652 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963189    5652 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963192    5652 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963195    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963197    5652 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963200    5652 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963203    5652 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963205    5652 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963208    5652 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963210    5652 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963213    5652 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963215    5652 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963218    5652 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963220    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:38:30.980753 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963236    5652 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963240    5652 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963243    5652 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963246    5652 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963248    5652 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963251    5652 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963254    5652 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963256    5652 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:38:30.963265    5652 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.963579    5652 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.965393    5652 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.965446    5652 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.965636    5652 server.go:1014] "Starting client certificate rotation"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.965771    5652 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.965825    5652 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:32:19 +0000 UTC" deadline="2028-07-02 22:59:33.835708499 +0000 UTC"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.965863    5652 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14668h21m2.869847734s"
Oct 30 18:38:30.981199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.966182    5652 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:38:30.981607 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.967247    5652 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:38:30.981607 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.968332    5652 log.go:25] "Validated CRI v1 runtime API"
Oct 30 18:38:30.981607 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.970688    5652 log.go:25] "Validated CRI v1 image API"
Oct 30 18:38:30.981607 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.971402    5652 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 18:38:30.981607 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.973489    5652 fs.go:135] Filesystem UUIDs: map[421749ad-0cdc-455b-97a7-c96509ac0904:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ced88d29-12c8-49a9-9899-c5b8dc9133ac:/dev/nvme0n1p3]
Oct 30 18:38:30.981867 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.973508    5652 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc/userdata/shm major:0 minor:392 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8/userdata/shm major:0 minor:331 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f18bf9b55c4395670e16730fbcebea3f621da30e09d10ffe23fd3708e91d073/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f18bf9b55c4395670e16730fbcebea3f621da30e09d10ffe23fd3708e91d073/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb/userdata/shm major:0 minor:252 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17/userdata/shm major:0 minor:384 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d/userdata/shm major:0 minor:395 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d/userdata/shm major:0 minor:391 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~projected/kube-api-access-bh6t9:{mountpoint:/var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~projected/kube-api-access-bh6t9 major:0 minor:248 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:247 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:245 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5/volumes/kubernetes.io~projected/kube-api-access-tpzr7:{mountpoint:/var/lib/kubelet/pods/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5/volumes/kubernetes.io~projected/kube-api-access-tpzr7 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1cdddf29-8df1-457c-b881-e50bf4cd6898/volumes/kubernetes.io~projected/kube-api-access-d2xk8:{mountpoint:/var/lib/kubelet/pods/1cdddf29-8df1-457c-b881-e50bf4cd6898/volumes/kubernetes.io~projected/kube-api-access-d2xk8 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1cdddf29-8df1-457c-b881-e50bf4cd6898/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/1cdddf29-8df1-457c-b881-e50bf4cd6898/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1da3b8e1-4a93-4493-b96b-d1d057f48c1c/volumes/kubernetes.io~projected/kube-api-access-zmdz8:{mountpoint:/var/lib/kubelet/pods/1da3b8e1-4a93-4493-b96b-d1d057f48c1c/volumes/kubernetes.io~projected/kube-api-access-zmdz8 major:0 minor:390 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a029bb1-97b8-4018-94f9-20b06c34db89/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/4a029bb1-97b8-4018-94f9-20b06c34db89/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a20b4f4-576f-4153-925a-3441a17d73d9/volumes/kubernetes.io~projected/kube-api-access-z4d4w:{mountpoint:/var/lib/kubelet/pods/4a20b4f4-576f-4153-925a-3441a17d73d9/volumes/kubernetes.io~projected/kube-api-access-z4d4w major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a20b4f4-576f-4153-925a-3441a17d73d9/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/4a20b4f4-576f-4153-925a-3441a17d73d9/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5682428d-476a-4cd6-b4c4-a17675fea5f2/volumes/kubernetes.io~projected/kube-api-access-gj4rn:{mountpoint:/var/lib/kubelet/pods/5682428d-476a-4cd6-b4c4-a17675fea5f2/volumes/kubernetes.io~projected/kube-api-access-gj4rn major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5682428d-476a-4cd6-b4c4-a17675fea5f2/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/5682428d-476a-4cd6-b4c4-a17675fea5f2/volumes/kubernetes.io~secret/metrics-certs major:0 minor:388 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/56cefe62-35cf-4953-937e-f46b87c1a928/volumes/kubernetes.io~projected/kube-api-access-g92wd:{mountpoint:/var/lib/kubelet/pods/56cefe62-35cf-4953-937e-f46b87c1a928/volumes/kubernetes.io~projected/kube-api-access-g92wd major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/56cefe62-35cf-4953-937e-f46b87c1a928/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/56cefe62-35cf-4953-937e-f46b87c1a928/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~projected/kube-api-access-gkjxl:{mountpoint:/var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~projected/kube-api-access-gkjxl major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~projected/kube-api-access-vrkpj:{mountpoint:/var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~projected/kube-api-access-vrkpj major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/alertmanager/9 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/config-reloader/6 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~empty-dir/config-out major:0 minor:279 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~projected/kube-api-access-w46fk:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~projected/kube-api-access-w46fk major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~projected/tls-assets major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/config-volume major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/web-config major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c63e418-061c-4f79-9d26-28fe2adba2cc/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/8c63e418-061c-4f79-9d26-28fe2adba2cc/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:389 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volumes/kubernetes.io~projected/kube-api-access-n8cbz:{mountpoint:/var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volumes/kubernetes.io~projected/kube-api-access-n8cbz major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa1148f4-6adb-46ec-96c8-d33ca9883fbd/volumes/kubernetes.io~projected/kube-api-access-5hpgf:{mountpoint:/var/lib/kubelet/pods/aa1148f4-6adb-46ec-96c8-d33ca9883fbd/volumes/kubernetes.io~projected/kube-api-access-5hpgf major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~projected/kube-api-access-wk9gn:{mountpoint:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~projected/kube-api-access-wk9gn major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db75277c-76a4-4127-b5c2-d6bead6f6db2/volumes/kubernetes.io~projected/kube-api-access-9dccn:{mountpoint:/var/lib/kubelet/pods/db75277c-76a4-4127-b5c2-d6bead6f6db2/volumes/kubernetes.io~projected/kube-api-access-9dccn major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e51c4bdb-690c-4608-b2ee-ba870b79719c/volumes/kubernetes.io~projected/kube-api-access-v66qk:{mountpoint:/var/lib/kubelet/pods/e51c4bdb-690c-4608-b2ee-ba870b79719c/volumes/kubernetes.io~projected/kube-api-access-v66qk major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7473358-5d80-4235-9f4f-f72c00a84d55/volumes/kubernetes.io~projected/kube-api-access-vhjqb:{mountpoint:/var/lib/kubelet/pods/e7473358-5d80-4235-9f4f-f72c00a84d55/volumes/kubernetes.io~projected/kube-api-access-vhjqb major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f7f00c4d-1310-4e08-ba66-d9720844b86f/volumes/kubernetes.io~projected/kube-api-access-vf67f:{mountpoint:/var/lib/kubelet/pods/f7f00c4d-1310-4e08-ba66-d9720844b86f/volumes/kubernetes.io~projected/kube-api-access-vf67f major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~projected/kube-api-access-2mnwh:{mountpoint:/var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~projected/kube-api-access-2mnwh major:0 minor:249 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:244 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/config-reloader/2 major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/prometheus/15 major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~empty-dir/config-out major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~projected/kube-api-access-m9fk5:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~projected/kube-api-access-m9fk5 major:0 minor:383 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~projected/tls-assets major:0 minor:376 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/config major:0 minor:380 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:381 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:374 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:375 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:378 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:379 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/web-config major:0 minor:382 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/4a9c0a863944d010ff2778d2948b4578a2d75b04dfcb9e3c34b4675875024e04/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/20a7cc385bcda6ea8fcc87d82d476bee90695be1a996c64e3b6f2de1338e0bac/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/b7f843319232e65a96400ab7a68af32c6f7dd029fe9d847638d836c3f2ced735/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/7c96b6a0524b8db1aa1101067032974dcfdcae3b2904e31c36c2ede3e07a931c/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/9ae7cd144efd7613ac246321f2cbeff4425eab36de9af33a07813abd623ead8f/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/67284042d2a04526b89f3e94e5f8728a06264315360f74d2ad86d581b38d63be/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/b4867aa0f13d7e49b4a990a85c7ec9ac96f7b8e1e04166107801e347ec3306cc/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/e2570a666e51bdf970d73a32890f97ebab1cc11783b40704bbef6119ea53fc8b/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/a822e8ace41888c3bfbc6fe47ae38ab3c4fdbd266a4df5e9eb0b5938eca500c4/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/40922995d8f0508a1b59ac6eb7b901803155a0c78bcb3091e84facb4fe2d98f8/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2450b1f64eb51ed34c261e34c0928af76fa2a7f8bf935d62d7dfdf7622526340/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/761dace268d353123b69cebb3b92b5d54968987502a7dd1efe53539f6231acca/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/a135190ef3afa4ec037fb7b448818f5e9f3309bb0e79dd2d85afe6a716c7ff0e/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/8ad7f96dafa8e14cc19a4ab29b5ec8771e41e45c9c54d83874d312a98a48cd65/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/7afd7f47809489e38ad483974765cc378a35ea2bed246b02c61948aa06949b80/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/6ff8bc79b51294aedcdcdcea2e4dbe8b0019ebaba692e828547a31ce889be165/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-171:{mountpoint:/var/lib/containers/storage/overlay/ce19ecb9e43d9875962c05b3a1087f2cbf0bb79d3a723933c8f498a121850f5a/merged major:0 minor:171 fsType:overlay blockSize:0} overlay_0-174:{mountpoint:/var/lib/containers/storage/overlay/101725c9119267abe991362871dabb3f1e56ce9ab5786f36a37c8670a61619d6/merged major:0 minor:174 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/eb2ad6685ae0c0119c59b0e29db329716e6528c8f5c24e2afc944f8ae76e9249/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/7ab558651bb15a0b0a1c2d47d4a044b279a1dc13996f728d76be61c156131fce/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f85c0315dac743846e3543a414c951e3a48bfc1979b26933a872de139a9c8b41/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/f946a420770f4fd7784ebd288a8e480f66fd3f82f90ca540378ca56a440b6765/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/f23156d9b1a618b10a3bb100e7a842f0a54be416dc06d546c5418fa96f1042e5/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/9f57ef94cbec73fa04288b1befab2f59e8e8f34fc51d5edf8ea3199bd843822a/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/d7e934518e2a4027ffa0fb7fb95a3ae120e2a9fdc6da2f3c0d4d47066882a13f/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/28dcb60fca0cbb07c2ca10cfc6ac9807e514c2fabafa47efca61bec4359efd55/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/80fbc02f4cc242a555256a9012dd3707f6075e19eb3610ba3231ffb71f54432d/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/06325652988ab54075c772acf06cbef7f6e25fd7b034164cfe5b7235e0558031/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/20ca17912676248049e01b9db4311854391f9355ef83b4dac362dd2cc74b1ea6/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/cc3999476408972801f6f5779ad8a9272ce7da6ec7782d3406575e1d8017adc3/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/7d6d74bb407f796703f4183c49932949df84d3b192321960f9d7567d4e3ee21b/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/fe97b48181f3968c037cb9cbad1f07bd2e0156086bf536a88a2cd2aab40870d5/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/4dc6201761d0c70c3015db4ec231506918b7c4454071cd8e9850e5de5529e2a6/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/debf8a8f9550e75338bd99582dc5afebb377339ad8b0b88d8aaf71f653923e9f/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/c7e1c5790a8edc4c908b2d8b88fef7072635eeaab8adcdf96463c43ca425fe39/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/4c1b29ea58881b72f033991aba40724b4754e07a053cee111a6bb36355391c8b/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/82c5b6d54294b5e9747f5d9186aa37da1ab6cd8802e82498a98df04faef0396a/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/3962d9510a2d5cf27f9b916da1c642e259646f1310391e03043cd0d0f7c3d4d9/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/b50d3e9d72675733170bdc1c31711db71399cec4112dedfe77af68c0a65f4945/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/df9af6cb626d01130e44f17c16a8c66dbacbbc17c2dc778b02b625ff4ec71b76/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/72163d68972bf55a3d2dcde0ea643de191870a399550429361b7b85b3bcc33d2/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/f7b7eff7d7c97036fa2fcf16d1e09ac3bcaa65795f1f211059f277a5e2cf0eea/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-333:{mountpoint:/var/lib/containers/storage/overlay/308215cf37bc699e624f7f7cbd6240f2e440abfa3f46b3dd8fd77089f017434b/merged major:0 minor:333 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/f5d8f814ba6b6b6308a786adad823d97b89de17935737cc214052cf36e17af02/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/6261dd8b0ed304caee439a3fc71ced9f82e4dcde8aaeec2b6bc4b45f69bfac68/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/a72e7ca22739d305ddb72545b2496f9f42a56c0d23f29f2a5eeffb706877487e/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/e46bc667dd8da62d88fc188ae4c5f629f4ce7809032c27d810014a677064b059/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/2ea5c8bf12c178a2be62bb8586876abc46dae360613b1cea36adc23d56350143/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/c9002562d4a5c47fe87e1471cf47347700eb06ec9c586ee575832a2f1faf164b/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/74565c5a12aac5aee46e839b989e6954ee867edfdf8101b2e82c32763fe1d1a5/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/1fcd32ae9482363985ccdd5668e5e41cba8c886ce5425b98601fc78f8aa554ff/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/7fe7608aeb26ea4b9977ea0ccf7dba4e65214945a5288f3e2c9ab8e1b3cd52c7/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/fadd4848461cd80bbbb34adc64e638c370606a9e4468ce581032c69cdefd871b/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/36c9f59025ff031db2353327e3247b37c262d4ba1d270769d9e04d648b887da4/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/9f9f50dc095b6cca6443df1e1946f8ac687dda5e377cb2f8eb2cad7a0b8a3fb6/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-405:{mountpoint:/var/lib/containers/storage/overlay/13335cdff31959c46d0f105cd1b4261cd12b64183fb8e56ec43d5f8ff3783666/merged major:0 minor:405 fsType:overlay blockSize:0} overlay_0-411:{mountpoint:/var/lib/containers/storage/overlay/1526aba48f6b9387a0213b470568dc787bc08fcbcdeca866a1f9b596472ee0f2/merged major:0 minor:411 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/a88d556a262f7c2baa06d53f315900783dbb5946d0e657a631f762e2a2e2c99b/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/215ad8086bb21feacd52a346885ffab9128b03629fe603e5f872c2e43eb00c62/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/50e9946447f8009a1764bac34c70ba4c9b943b8b194e722c94f66d9c84ad3b69/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/d6041226a6758e6b3901da4a1593f8bc80609375779c90b139324ac38b7ea95d/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/c654e2735648f2ee559ea16528468eb50df94a3b0a6061914578246f398ec7d1/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-442:{mountpoint:/var/lib/containers/storage/overlay/8dd4cfecdf96d3f214fe0d05868bd7f2996f1ccd17b0de46ee2b9afa1f1d218c/merged major:0 minor:442 fsType:overlay blockSize:0} overlay_0-447:{mountpoint:/var/lib/containers/storage/overlay/437ec5b544c6e4657cd03fce1412acb933236d3e7eeae14eee07fc06bb725b3e/merged major:0 minor:447 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/037833530de6de99cb5390349aa274a88247b2208e38b564369a7970cbb1c9ad/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/a93b9424342fa8ed5123b79605e01ed9be01b68d1364820aa036ad656ac4588b/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/4e0de7c705a8010b5a48b22171e54bab749b0c84397746a6a85735bb962845f7/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/37b9c3af4fc2833a7002da16d6f2394159e9450ebf6f91c12c8400dc8b055212/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/559377323a8010aa4c98119acaad5c4a347842df3ba211b3aa56c218111b0612/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/99484cb26726e11c00db372269788b13da78354388cb8bac009fe1d6c8a29b16/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/4451ae108ca9e1d0e92b17e8dec787a70aa4512e18c5bbe9b8a828019d3eda56/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/2642e306c01c86ae51c6493c5cc931f84759e23bae1b2df4124b437ebc8fdd9d/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/27be6fb8c71351476669334ead9d9fd5b14c08d411c3e7bfb346cf31a08f15f1/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/7a01965bdbb2ac58bcd9f08c311254f15ffa80ec4844236b23bc16674f143a75/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 18:38:30.983909 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.983509    5652 manager.go:217] Machine: {Timestamp:2026-10-30 18:38:30.982841916 +0000 UTC m=+0.063512282 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120919 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b80a11013516ce53334ee11c5c0cd SystemUUID:ec2b80a1-1013-516c-e533-34ee11c5c0cd BootID:80b67a1a-e718-4f64-b8da-9ce035fca3c1 Filesystems:[{Device:/var/lib/kubelet/pods/56cefe62-35cf-4953-937e-f46b87c1a928/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/075cc3667e34f98eba8e23ea9412601b10afb84c0021ba8d6586847e2e476689/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/48d1577c25c772054fbf59cdeea5c2cabdec4db9f8ff842ef2291e023dd89726/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5682428d-476a-4cd6-b4c4-a17675fea5f2/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:388 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1cdddf29-8df1-457c-b881-e50bf4cd6898/volumes/kubernetes.io~projected/kube-api-access-d2xk8 DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8847e9509467ad8c391045a5b4d89ad3a0ed2b2ed50de4f6531b11e8e0225ae0/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0634022a2cb97e4a58d093e5f5de8c55985abdba01fe8c6ab01369c03a227018/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:283 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~projected/kube-api-access-w46fk DeviceMajor:0 DeviceMinor:291 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05e26671674ab23c0f46b354a2c04b78bd8954d9ed3526543a821fb3ecf0cfe8/userdata/shm DeviceMajor:0 DeviceMinor:331 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:380 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b9ebf574b068b87737f62a76f3603b8fbe9483b176737d329458a17eea29279f/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/56cefe62-35cf-4953-937e-f46b87c1a928/volumes/kubernetes.io~projected/kube-api-access-g92wd DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8c63e418-061c-4f79-9d26-28fe2adba2cc/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:389 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:382 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:244 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:290 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:373 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c6eb80691b6e34efa8bed658875e6ba0d023b95cb6ef2f492a1dac1b1cacae17/userdata/shm DeviceMajor:0 DeviceMinor:384 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5/volumes/kubernetes.io~projected/kube-api-access-tpzr7 DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a20b4f4-576f-4153-925a-3441a17d73d9/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:287 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1da3b8e1-4a93-4493-b96b-d1d057f48c1c/volumes/kubernetes.io~projected/kube-api-access-zmdz8 DeviceMajor:0 DeviceMinor:390 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1cdddf29-8df1-457c-b881-e50bf4cd6898/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~projected/kube-api-access-bh6t9 DeviceMajor:0 DeviceMinor:248 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0598a15c52603752771ab2460efa9ee10922a61adb1cbd63d15026a20e298acc/userdata/shm DeviceMajor:0 DeviceMinor:392 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7edea22b553b90e2c31336c7f9d2ea4b7c559d24296fca5b02e996bcbc4a5ab3/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d7268a51a1433e6260e4153cb4b3e70b9a8bd2e55fe1c3f5e7b0b9749810ac6/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:245 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:328 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-171 DeviceMajor:0 DeviceMinor:171 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:247 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:376 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volumes/kubernetes.io~projected/kube-api-access-n8cbz DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~projected/kube-api-access-2mnwh DeviceMajor:0 DeviceMinor:249 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:286 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f241eda2e0d2bb4f9c01b4acaa453eda637a7c89df7c3dd774aa7cbcabd58a8d/userdata/shm DeviceMajor:0 DeviceMinor:391 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/aa1148f4-6adb-46ec-96c8-d33ca9883fbd/volumes/kubernetes.io~projected/kube-api-access-5hpgf DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a80cac0c1549fe743c4a5cba033bdf8b4c9c112c5070a9c356c4e6e4c9ef47f0/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-411 DeviceMajor:0 DeviceMinor:411 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~projected/kube-api-access-gkjxl DeviceMajor:0 DeviceMinor:241 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fd305194-b939-401e-a5d0-b0f38e8aae86/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:246 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e51c4bdb-690c-4608-b2ee-ba870b79719c/volumes/kubernetes.io~projected/kube-api-access-v66qk DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e7473358-5d80-4235-9f4f-f72c00a84d55/volumes/kubernetes.io~projected/kube-api-access-vhjqb DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/db75277c-76a4-4127-b5c2-d6bead6f6db2/volumes/kubernetes.io~projected/kube-api-access-9dccn DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:382 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-447 DeviceMajor:0 DeviceMinor:447 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e55d0d0c3381a1cae9ae7cb53a7225736b91d9360cfdf1b86781076527680c0/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0fc1fc37a6213559daa858c7cc255ab3af858570540a07eda8b13b9788cb01fb/userdata/shm DeviceMajor:0 DeviceMinor:252 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:374 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-442 DeviceMajor:0 DeviceMinor:442 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/71250631b4478bbd82ec34d3d7282fac404d9395dfd2b31c088a2d2bddf5686d/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:289 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-333 DeviceMajor:0 DeviceMinor:333 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b415ede2069b2c248e78f852933ccb95dba27808a6d69abcc4d86fc471ba4d04/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a20b4f4-576f-4153-925a-3441a17d73d9/volumes/kubernetes.io~projected/kube-api-access-z4d4w DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:240 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:279 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:377 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~projected/kube-api-access-wk9gn DeviceMajor:0 DeviceMinor:330 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:369 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d02e71e-b1a9-4e13-85a2-92435ed108c6/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:236 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:287 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~projected/kube-api-access-m9fk5 DeviceMajor:0 DeviceMinor:383 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:375 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:382 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-174 DeviceMajor:0 DeviceMinor:174 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:287 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:329 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/9581611c-5430-475b-bd37-26c7e13b3fbd/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~projected/kube-api-access-vrkpj DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ad9721b2c32be89ff37069688520e94f1be423d7cbcceca6dee835dcee5fc7f/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:285 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4a029bb1-97b8-4018-94f9-20b06c34db89/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b527fd7f2c19c6ceb6dbe57cf5fd6f56a81cefe403ef1ff0d6b684d1badba8f2/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/764ba139-faa5-4431-b64e-d3e0d2866470/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5682428d-476a-4cd6-b4c4-a17675fea5f2/volumes/kubernetes.io~projected/kube-api-access-gj4rn DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:379 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b369e7ad-ff3d-4a1e-9031-906027c85d2a/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:324 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/77141143-0ae3-4a7d-ba64-9bab0c3bf939/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:287 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:382 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c9e821676340047f5e2c55ccbb78c441ecd2588b5acbe1ad312265ce4c72996d/userdata/shm DeviceMajor:0 DeviceMinor:395 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:381 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-405 DeviceMajor:0 DeviceMinor:405 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f7f00c4d-1310-4e08-ba66-d9720844b86f/volumes/kubernetes.io~projected/kube-api-access-vf67f DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f18bf9b55c4395670e16730fbcebea3f621da30e09d10ffe23fd3708e91d073/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fdc0656d-bf19-4ed8-a70c-e44afb11dea5/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:378 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0598a15c5260375 MacAddress:de:66:7c:f2:cf:33 Speed:10000 Mtu:8901} {Name:05e26671674ab23 MacAddress:9a:81:e7:9d:a9:3c Speed:10000 Mtu:8901} {Name:0634022a2cb97e4 MacAddress:0e:7c:71:db:7f:c0 Speed:10000 Mtu:8901} {Name:075cc3667e34f98 MacAddress:8e:d8:16:20:aa:f6 Speed:10000 Mtu:8901} {Name:0f18bf9b55c4395 MacAddress:56:22:98:04:69:28 Speed:10000 Mtu:8901} {Name:7ad9721b2c32be8 MacAddress:9a:75:fa:14:46:53 Speed:10000 Mtu:8901} {Name:7edea22b553b90e MacAddress:22:41:5d:56:eb:f9 Speed:10000 Mtu:8901} {Name:a80cac0c1549fe7 MacAddress:ba:f8:86:32:f9:45 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:e2:f3:2b:09 Speed:0 Mtu:9001} {Name:br-int MacAddress:ce:23:4c:1f:b7:04 Speed:0 Mtu:8901} {Name:c6eb80691b6e34e MacAddress:62:99:0d:d3:94:81 Speed:10000 Mtu:8901} {Name:c9e821676340047 MacAddress:4a:7f:fc:dc:c3:ce Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:e2:f3:2b:09 Speed:0 Mtu:9001} {Name:f241eda2e0d2bb4 MacAddress:82:d1:a6:db:df:15 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:d6:ef:d4:3a:32:b2 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:06:3d:2d:57:2a:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 18:38:30.983909 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.983911    5652 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 18:38:30.984246 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.983953    5652 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 18:38:30.984283 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984256    5652 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 18:38:30.984400 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984283    5652 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-244.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 18:38:30.984459 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984402    5652 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 18:38:30.984459 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984410    5652 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 18:38:30.984459 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984420    5652 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:38:30.984459 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984433    5652 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:38:30.984571 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984498    5652 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 18:38:30.984654 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984643    5652 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 18:38:30.984756 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984747    5652 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 18:38:30.984794 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984781    5652 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 18:38:30.984823 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984794    5652 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 18:38:30.984823 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984804    5652 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 18:38:30.984823 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984812    5652 kubelet.go:405] "Adding apiserver pod source"
Oct 30 18:38:30.984823 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.984820    5652 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 18:38:30.985566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.985553    5652 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 18:38:30.985566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.985567    5652 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:38:30.986044 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.986028    5652 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 18:38:30.988843 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.988828    5652 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 18:38:30.988843 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.988843    5652 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:38:30.988951 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.988941    5652 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 18:38:30.989133 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989122    5652 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 18:38:30.989163 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989153    5652 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 18:38:30.989279 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989269    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 18:38:30.989316 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989285    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 18:38:30.989316 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989292    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 18:38:30.989316 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989300    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 18:38:30.989316 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989309    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989318    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989326    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989332    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989339    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989345    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989359    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989369    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989399    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 18:38:30.989415 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.989407    5652 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 18:38:30.992760 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.992746    5652 server.go:1263] "Started kubelet"
Oct 30 18:38:30.993315 ip-10-0-133-244 systemd[1]: Started Kubernetes Kubelet.
Oct 30 18:38:30.993629 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.993523    5652 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 18:38:30.993781 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.993152    5652 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 18:38:30.993781 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.993740    5652 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 18:38:30.994155 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.994134    5652 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 18:38:30.995327 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.995286    5652 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 18:38:30.998490 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998472    5652 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998653    5652 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998742    5652 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998754    5652 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998774    5652 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:32:21 +0000 UTC" deadline="2028-07-18 04:23:32.753203976 +0000 UTC"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998809    5652 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15033h45m1.754398716s"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:30.998862    5652 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:30.998863    5652 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001655    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15f9c425-4dc6-48c2-9db0-11dc60b2d1c5" volumeName="kubernetes.io/projected/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kube-api-access-tpzr7" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001682    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cdddf29-8df1-457c-b881-e50bf4cd6898" volumeName="kubernetes.io/secret/1cdddf29-8df1-457c-b881-e50bf4cd6898-metrics-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001692    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a029bb1-97b8-4018-94f9-20b06c34db89" volumeName="kubernetes.io/secret/4a029bb1-97b8-4018-94f9-20b06c34db89-agent-certs" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001700    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" volumeName="kubernetes.io/projected/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-kube-api-access-5hpgf" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001706    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001714    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config-out" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001721    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9581611c-5430-475b-bd37-26c7e13b3fbd" volumeName="kubernetes.io/secret/9581611c-5430-475b-bd37-26c7e13b3fbd-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001727    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd305194-b939-401e-a5d0-b0f38e8aae86" volumeName="kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001737    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001744    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cdddf29-8df1-457c-b881-e50bf4cd6898" volumeName="kubernetes.io/empty-dir/1cdddf29-8df1-457c-b881-e50bf4cd6898-tmp-dir" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001751    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56cefe62-35cf-4953-937e-f46b87c1a928" volumeName="kubernetes.io/secret/56cefe62-35cf-4953-937e-f46b87c1a928-cert" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001759    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d02e71e-b1a9-4e13-85a2-92435ed108c6" volumeName="kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001767    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="764ba139-faa5-4431-b64e-d3e0d2866470" volumeName="kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-tmp" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001775    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001795    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51c4bdb-690c-4608-b2ee-ba870b79719c" volumeName="kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-cni-binary-copy" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001802    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd305194-b939-401e-a5d0-b0f38e8aae86" volumeName="kubernetes.io/empty-dir/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-textfile" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001810    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001823    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="764ba139-faa5-4431-b64e-d3e0d2866470" volumeName="kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-etc-tuned" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001830    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001837    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-main-db" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001845    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c63e418-061c-4f79-9d26-28fe2adba2cc" volumeName="kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001853    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9581611c-5430-475b-bd37-26c7e13b3fbd" volumeName="kubernetes.io/projected/9581611c-5430-475b-bd37-26c7e13b3fbd-kube-api-access-n8cbz" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001860    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001868    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db75277c-76a4-4127-b5c2-d6bead6f6db2" volumeName="kubernetes.io/empty-dir/db75277c-76a4-4127-b5c2-d6bead6f6db2-tmp-dir" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001875    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db75277c-76a4-4127-b5c2-d6bead6f6db2" volumeName="kubernetes.io/projected/db75277c-76a4-4127-b5c2-d6bead6f6db2-kube-api-access-9dccn" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001882    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8a5d1c-491a-4031-86cc-d5fbe2d07f62" volumeName="kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001890    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-kube-api-access-w46fk" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001898    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001907    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/projected/b369e7ad-ff3d-4a1e-9031-906027c85d2a-kube-api-access-wk9gn" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001920    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-client-ca-bundle" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001928    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7f00c4d-1310-4e08-ba66-d9720844b86f" volumeName="kubernetes.io/projected/f7f00c4d-1310-4e08-ba66-d9720844b86f-kube-api-access-vf67f" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001936    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001944    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5682428d-476a-4cd6-b4c4-a17675fea5f2" volumeName="kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001951    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001958    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9581611c-5430-475b-bd37-26c7e13b3fbd" volumeName="kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-env-overrides" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001968    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-tls-assets" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001975    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-grpc-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001981    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-tls-assets" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001990    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-volume" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.001997    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/empty-dir/b369e7ad-ff3d-4a1e-9031-906027c85d2a-audit-log" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002015    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd305194-b939-401e-a5d0-b0f38e8aae86" volumeName="kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002024    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002032    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002040    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1da3b8e1-4a93-4493-b96b-d1d057f48c1c" volumeName="kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002048    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a029bb1-97b8-4018-94f9-20b06c34db89" volumeName="kubernetes.io/configmap/4a029bb1-97b8-4018-94f9-20b06c34db89-konnectivity-ca" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002055    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51c4bdb-690c-4608-b2ee-ba870b79719c" volumeName="kubernetes.io/projected/e51c4bdb-690c-4608-b2ee-ba870b79719c-kube-api-access-v66qk" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002063    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd305194-b939-401e-a5d0-b0f38e8aae86" volumeName="kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002070    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8a5d1c-491a-4031-86cc-d5fbe2d07f62" volumeName="kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002078    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8a5d1c-491a-4031-86cc-d5fbe2d07f62" volumeName="kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002111    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20b4f4-576f-4153-925a-3441a17d73d9" volumeName="kubernetes.io/projected/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-api-access-z4d4w" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002119    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20b4f4-576f-4153-925a-3441a17d73d9" volumeName="kubernetes.io/secret/4a20b4f4-576f-4153-925a-3441a17d73d9-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002126    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002137    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5682428d-476a-4cd6-b4c4-a17675fea5f2" volumeName="kubernetes.io/projected/5682428d-476a-4cd6-b4c4-a17675fea5f2-kube-api-access-gj4rn" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002150    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d02e71e-b1a9-4e13-85a2-92435ed108c6" volumeName="kubernetes.io/configmap/6d02e71e-b1a9-4e13-85a2-92435ed108c6-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002157    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-out" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002165    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002177    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9581611c-5430-475b-bd37-26c7e13b3fbd" volumeName="kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-config" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002184    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9581611c-5430-475b-bd37-26c7e13b3fbd" volumeName="kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002191    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002198    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8a5d1c-491a-4031-86cc-d5fbe2d07f62" volumeName="kubernetes.io/projected/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-api-access-bh6t9" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002206    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d02e71e-b1a9-4e13-85a2-92435ed108c6" volumeName="kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002213    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" volumeName="kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002220    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b369e7ad-ff3d-4a1e-9031-906027c85d2a" volumeName="kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002244    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7473358-5d80-4235-9f4f-f72c00a84d55" volumeName="kubernetes.io/projected/e7473358-5d80-4235-9f4f-f72c00a84d55-kube-api-access-vhjqb" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002251    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002258    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8a5d1c-491a-4031-86cc-d5fbe2d07f62" volumeName="kubernetes.io/empty-dir/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-volume-directive-shadow" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002268    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20b4f4-576f-4153-925a-3441a17d73d9" volumeName="kubernetes.io/configmap/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002275    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56cefe62-35cf-4953-937e-f46b87c1a928" volumeName="kubernetes.io/projected/56cefe62-35cf-4953-937e-f46b87c1a928-kube-api-access-g92wd" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002283    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd305194-b939-401e-a5d0-b0f38e8aae86" volumeName="kubernetes.io/projected/fd305194-b939-401e-a5d0-b0f38e8aae86-kube-api-access-2mnwh" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002290    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002297    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002304    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002312    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-web-config" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002318    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d02e71e-b1a9-4e13-85a2-92435ed108c6" volumeName="kubernetes.io/projected/6d02e71e-b1a9-4e13-85a2-92435ed108c6-kube-api-access-gkjxl" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002327    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="764ba139-faa5-4431-b64e-d3e0d2866470" volumeName="kubernetes.io/projected/764ba139-faa5-4431-b64e-d3e0d2866470-kube-api-access-vrkpj" seLinuxMountContext=""
Oct 30 18:38:31.002258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002334    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-web-config" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002342    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002349    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e51c4bdb-690c-4608-b2ee-ba870b79719c" volumeName="kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-daemon-config" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002356    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7473358-5d80-4235-9f4f-f72c00a84d55" volumeName="kubernetes.io/configmap/e7473358-5d80-4235-9f4f-f72c00a84d55-iptables-alerter-script" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002362    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002370    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a8a5d1c-491a-4031-86cc-d5fbe2d07f62" volumeName="kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002377    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77141143-0ae3-4a7d-ba64-9bab0c3bf939" volumeName="kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-cluster-tls-config" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002384    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7f00c4d-1310-4e08-ba66-d9720844b86f" volumeName="kubernetes.io/configmap/f7f00c4d-1310-4e08-ba66-d9720844b86f-serviceca" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002390    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd305194-b939-401e-a5d0-b0f38e8aae86" volumeName="kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-tls" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002397    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-kube-api-access-m9fk5" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002406    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cdddf29-8df1-457c-b881-e50bf4cd6898" volumeName="kubernetes.io/configmap/1cdddf29-8df1-457c-b881-e50bf4cd6898-config-volume" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002414    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cdddf29-8df1-457c-b881-e50bf4cd6898" volumeName="kubernetes.io/projected/1cdddf29-8df1-457c-b881-e50bf4cd6898-kube-api-access-d2xk8" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002421    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20b4f4-576f-4153-925a-3441a17d73d9" volumeName="kubernetes.io/empty-dir/4a20b4f4-576f-4153-925a-3441a17d73d9-data-volume" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002427    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" volumeName="kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002434    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002441    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002447    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002455    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" volumeName="kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-binary-copy" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002461    5652 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" volumeName="kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002468    5652 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.002473    5652 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.003653    5652 factory.go:55] Registering systemd factory
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.003669    5652 factory.go:223] Registration of the systemd container factory successfully
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.003888    5652 factory.go:153] Registering CRI-O factory
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.003904    5652 factory.go:223] Registration of the crio container factory successfully
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.003966    5652 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.003991    5652 factory.go:103] Registering Raw factory
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.004005    5652 manager.go:1199] Started watching for new ooms in manager
Oct 30 18:38:31.006276 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.004360    5652 manager.go:319] Starting recovery of all containers
Oct 30 18:38:31.030611 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.030580    5652 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 18:38:31.032502 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.032479    5652 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 18:38:31.032502 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.032499    5652 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 18:38:31.032645 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.032518    5652 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 18:38:31.032645 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.032556    5652 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 18:38:31.042102 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.042070    5652 generic.go:356] "Generic (PLEG): container finished" podID="b1fd34ddbb219fc4a25ad1761211ca99" containerID="7760a9a7d7505d1a1defdd003602d22e3e22189b883ce6d0d88431fa465d5bff" exitCode=0
Oct 30 18:38:31.064645 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.064610    5652 generic.go:356] "Generic (PLEG): container finished" podID="fdc0656d-bf19-4ed8-a70c-e44afb11dea5" containerID="98351f25ef81a0c5770fbc59b248c6e524c6910cc80462370eeeefe4290aa66d" exitCode=0
Oct 30 18:38:31.068290 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.068265    5652 generic.go:356] "Generic (PLEG): container finished" podID="77141143-0ae3-4a7d-ba64-9bab0c3bf939" containerID="b286d6b29b8e91c4da40077c02395b8bc07e49cf1087a6bd03a23d250f86ed17" exitCode=0
Oct 30 18:38:31.070565 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.070538    5652 generic.go:356] "Generic (PLEG): container finished" podID="fd305194-b939-401e-a5d0-b0f38e8aae86" containerID="25ef1cdcc2bb39eeb73fc6e1d3db187c026079f2c912cc28322475f99af945d1" exitCode=0
Oct 30 18:38:31.093601 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.093579    5652 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="47d06fda8b635ccc52f320dc9b05633665e459e06d4edd3f69570af80a052b7f" exitCode=0
Oct 30 18:38:31.093743 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.093601    5652 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="cb6ae6e6f05296ab9e216e46be3d4a576052eed4ae537f827c4fb360b8498586" exitCode=0
Oct 30 18:38:31.093743 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.093611    5652 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="3b006c49e3b3da9f59c741530c8c0ffe419f2450ed5aa9c24a2c5e3b46f6e99d" exitCode=0
Oct 30 18:38:31.093743 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.093619    5652 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="4acc81569bff9238449c8ee8242f2f8efd717c04eda771ae0929dfec2d743914" exitCode=0
Oct 30 18:38:31.093743 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.093627    5652 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="68c3c48cc31214407ff30cb78d7ae2eafdb0f80ab5cafdc8ed19854269bfbcb9" exitCode=0
Oct 30 18:38:31.093743 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.093635    5652 generic.go:356] "Generic (PLEG): container finished" podID="aa1148f4-6adb-46ec-96c8-d33ca9883fbd" containerID="9f9026d760b5abee0596d4fb2805a533e047f8a8ca4cf40b4c1de8af2f62ba91" exitCode=0
Oct 30 18:38:31.098988 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.098933    5652 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:38:31.110655 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.110640    5652 manager.go:324] Recovery completed
Oct 30 18:38:31.131478 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.131452    5652 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:38:31.132814 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.132798    5652 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 18:38:31.133036 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.133022    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:38:31.133081 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.133055    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:38:31.133081 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.133067    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:38:31.135681 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135665    5652 cpu_manager.go:226] "Starting" policy="none"
Oct 30 18:38:31.135681 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135680    5652 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 18:38:31.135804 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135683    5652 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:38:31.135804 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135699    5652 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 18:38:31.135885 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135837    5652 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 18:38:31.135885 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135852    5652 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 18:38:31.135938 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135888    5652 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 18:38:31.135938 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135897    5652 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 18:38:31.135938 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135904    5652 policy_none.go:50] "Start"
Oct 30 18:38:31.135938 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135914    5652 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 18:38:31.135938 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.135925    5652 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 18:38:31.136116 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.136102    5652 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 18:38:31.136149 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.136119    5652 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 18:38:31.136149 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.136127    5652 policy_none.go:44] "Start"
Oct 30 18:38:31.136595 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.136579    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:38:31.136650 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.136613    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:38:31.136650 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.136625    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:38:31.141006 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.140982    5652 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 18:38:31.144478 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144465    5652 manager.go:341] "Starting Device Plugin manager"
Oct 30 18:38:31.144544 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.144490    5652 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 18:38:31.144544 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144500    5652 server.go:87] "Starting device plugin registration server"
Oct 30 18:38:31.144758 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144746    5652 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 18:38:31.144826 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144759    5652 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 18:38:31.144876 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144839    5652 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 18:38:31.144960 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144931    5652 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 18:38:31.145008 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144982    5652 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 18:38:31.145008 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.144989    5652 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 18:38:31.145948 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.145036    5652 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:38:31.144958285Z","UUID":"b03f2069-5d0a-48d7-b6bc-9f2cb60b7558","Handler":null,"Name":"","Endpoint":""}
Oct 30 18:38:31.146444 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.146404    5652 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 18:38:31.146444 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.146436    5652 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 18:38:31.146583 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.146524    5652 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 18:38:31.146583 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.146562    5652 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-244.us-west-2.compute.internal\" not found"
Oct 30 18:38:31.197573 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.197531    5652 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:38:31.197798 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.197779    5652 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 18:38:31.208099 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.208078    5652 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:38:31.245486 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.245466    5652 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:38:31.246307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.246289    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:38:31.246388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.246323    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:38:31.246388 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.246337    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:38:31.246509 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.246427    5652 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.286581 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.286563    5652 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:38:31.289461 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.289442    5652 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:38:31.333794 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.333753    5652 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"]
Oct 30 18:38:31.334407 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334376    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"b1fd34ddbb219fc4a25ad1761211ca99","Type":"ContainerStarted","Data":"385043f973dba81283992276f2074ce138d915ceb7febb5e7ae1ea366d43346a"}
Oct 30 18:38:31.334458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334419    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"b1fd34ddbb219fc4a25ad1761211ca99","Type":"ContainerDied","Data":"7760a9a7d7505d1a1defdd003602d22e3e22189b883ce6d0d88431fa465d5bff"}
Oct 30 18:38:31.334458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334442    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"b1fd34ddbb219fc4a25ad1761211ca99","Type":"ContainerStarted","Data":"76dcf5adc868d42faf5b46c1747164ef3b0d330746d17f90c834c537c8bf9c8d"}
Oct 30 18:38:31.334535 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334454    5652 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.334535 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334530    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"280f4af3efbb64161ef5d0dff38bf2c2","Type":"ContainerStarted","Data":"e373aad4de3b964ecfa4969dd117f48e07ccaa955f07dcc9753613a741dcf73e"}
Oct 30 18:38:31.334606 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334546    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" event={"ID":"280f4af3efbb64161ef5d0dff38bf2c2","Type":"ContainerStarted","Data":"6861aff70d46efc0d296d085d767261f7786bfc383c9f005763f146e86279a72"}
Oct 30 18:38:31.334606 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.334579    5652 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.359194 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.359140    5652 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.359288 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.359202    5652 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.359781 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.359767    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeNotReady"
Oct 30 18:38:31.359835 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.359794    5652 setters.go:546] "Node became not ready" node="ip-10-0-133-244.us-west-2.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T18:38:31Z","lastTransitionTime":"2026-10-30T18:38:31Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 18:38:31.432120 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.432094    5652 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:38:31.432245 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.432139    5652 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.436959 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.436946    5652 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:38:31.437023 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:31.436975    5652 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.499476 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.499450    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.499559 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.499483    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.499559 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.499503    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/280f4af3efbb64161ef5d0dff38bf2c2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"280f4af3efbb64161ef5d0dff38bf2c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.545970 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.545943    5652 nodeinfomanager.go:471] existing CSINode "ip-10-0-133-244.us-west-2.compute.internal" is owned by different node (oldNodeID="e4937e90-7a05-44d2-ac26-a9943c6c291f", newNodeID=""), cleaning up...
Oct 30 18:38:31.600578 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.600549    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.600679 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.600581    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.600679 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.600600    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/280f4af3efbb64161ef5d0dff38bf2c2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"280f4af3efbb64161ef5d0dff38bf2c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.600679 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.600651    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/280f4af3efbb64161ef5d0dff38bf2c2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"280f4af3efbb64161ef5d0dff38bf2c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.600766 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.600670    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.600766 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.600670    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1fd34ddbb219fc4a25ad1761211ca99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" (UID: \"b1fd34ddbb219fc4a25ad1761211ca99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:31.985727 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:31.985698    5652 apiserver.go:52] "Watching apiserver"
Oct 30 18:38:32.097885 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.097862    5652 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 18:38:32.098408 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.098383    5652 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:32.098544 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.098496    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nk68x","openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l","openshift-network-diagnostics/network-check-target-pqztj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj","openshift-monitoring/node-exporter-ztgh2","openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp","openshift-dns/node-resolver-hqx6v","kube-system/global-pull-secret-syncer-rq9kn","openshift-ingress-canary/ingress-canary-jlkk2","openshift-multus/multus-p4kbp","openshift-image-registry/node-ca-wn9rz","kube-system/konnectivity-agent-g66m2","openshift-monitoring/metrics-server-c898556f7-rxxgm","openshift-network-operator/iptables-alerter-fckwv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-b2t2n","openshift-multus/network-metrics-daemon-29tfr","kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal","openshift-monitoring/alertmanager-main-0","openshift-ovn-kubernetes/ovnkube-node-fvgxt","openshift-cluster-node-tuning-operator/tuned-l7ln5","openshift-dns/dns-default-7k2jl","openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:32.098631 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.098552    5652 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:32.103872 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.103840    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-system-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.103966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.103884    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-var-lib-kubelet\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.104024 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.103954    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-conf-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104024 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.103998    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-etc-kubernetes\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104179 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104061    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66qk\" (UniqueName: \"kubernetes.io/projected/e51c4bdb-690c-4608-b2ee-ba870b79719c-kube-api-access-v66qk\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104196    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-kubelet\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104255    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-daemon-config\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104285    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-modprobe-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.104523 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104495    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-systemd\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.104603 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104532    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-run\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.104603 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104577    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-host\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.104720 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104609    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-bin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104720 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104640    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-hostroot\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104856 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104784    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-multus-certs\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.104856 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104825    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysconfig\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.104983 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.104969    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-conf\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105036 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105006    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-sys\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105101 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105041    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-lib-modules\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105101 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105078    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-etc-tuned\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105201 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105119    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkpj\" (UniqueName: \"kubernetes.io/projected/764ba139-faa5-4431-b64e-d3e0d2866470-kube-api-access-vrkpj\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105201 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105165    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105602 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105580    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-socket-dir-parent\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105693 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105622    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-k8s-cni-cncf-io\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105693 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105654    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-netns\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105693 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105684    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-multus\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105845 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105719    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-kubernetes\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105894 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105862    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.105942 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105897    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-cnibin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105996 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105946    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-cni-binary-copy\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.105996 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.105976    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-tmp\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.106134 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.106119    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-tmp\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.106552 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.106532    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764ba139-faa5-4431-b64e-d3e0d2866470-etc-tuned\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.160740 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.160720    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 18:38:32.161635 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.161618    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.161703 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.161660    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.162547 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162531    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqqcl\""
Oct 30 18:38:32.162614 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162576    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.162614 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162591    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.162614 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162606    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 18:38:32.162735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162621    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 18:38:32.162735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162578    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.162735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162637    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.162735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162637    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w4fd8\""
Oct 30 18:38:32.162735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162651    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-lp85d\""
Oct 30 18:38:32.162735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.162640    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 18:38:32.163470 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163455    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.163756 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163743    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.163851 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163774    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.163851 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163825    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.163917 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163873    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.163917 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163876    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 18:38:32.163917 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.163907    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 18:38:32.164655 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.164643    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 18:38:32.164734 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.164721    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-daemon-config\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.164870 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.164861    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.165078 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.165063    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 18:38:32.165196 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.165170    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 18:38:32.165274 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.165262    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.166064 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.166047    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.167198 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.167185    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e51c4bdb-690c-4608-b2ee-ba870b79719c-cni-binary-copy\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.168066 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.168052    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-czdz5\""
Oct 30 18:38:32.168066 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.168060    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 18:38:32.168221 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.168052    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 18:38:32.168402 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.168389    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j99tc\""
Oct 30 18:38:32.169504 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.169489    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 18:38:32.169583 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.169527    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hlrng\""
Oct 30 18:38:32.169583 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.169527    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9cgrs\""
Oct 30 18:38:32.169669 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.169624    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 18:38:32.172007 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.171993    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gh5g8\""
Oct 30 18:38:32.172270 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.172258    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsdbf\""
Oct 30 18:38:32.175574 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.175558    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 18:38:32.175646 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.175623    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66qk\" (UniqueName: \"kubernetes.io/projected/e51c4bdb-690c-4608-b2ee-ba870b79719c-kube-api-access-v66qk\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.175780 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.175766    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4rg2h\""
Oct 30 18:38:32.176012 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.175996    5652 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:38:32.176070 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.176014    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-smcdv\""
Oct 30 18:38:32.176070 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:32.176049    5652 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:32.177536 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.177521    5652 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:38:32.177624 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:32.177558    5652 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-244.us-west-2.compute.internal"
Oct 30 18:38:32.177877 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.177858    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkpj\" (UniqueName: \"kubernetes.io/projected/764ba139-faa5-4431-b64e-d3e0d2866470-kube-api-access-vrkpj\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.201637 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.201617    5652 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 18:38:32.206985 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.206962    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-bin\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.207040 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.206996    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20b4f4-576f-4153-925a-3441a17d73d9-data-volume\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.207040 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207012    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-netns\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.207040 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207027    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-modprobe-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207187 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207082    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-run\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207187 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207105    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-host\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207187 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207148    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-root\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.207187 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207165    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d02e71e-b1a9-4e13-85a2-92435ed108c6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.207187 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207180    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-modprobe-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207194    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-run\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207197    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207199    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20b4f4-576f-4153-925a-3441a17d73d9-data-volume\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207206    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-host\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207264    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db75277c-76a4-4127-b5c2-d6bead6f6db2-hosts-file\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207343    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.207406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207397    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysconfig\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207409    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207423    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207460    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysconfig\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207463    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207503    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207543    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db75277c-76a4-4127-b5c2-d6bead6f6db2-tmp-dir\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207582    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207600    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207609    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db75277c-76a4-4127-b5c2-d6bead6f6db2-tmp-dir\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207619    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwh\" (UniqueName: \"kubernetes.io/projected/fd305194-b939-401e-a5d0-b0f38e8aae86-kube-api-access-2mnwh\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207643    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207667    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-socket-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207696    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.207737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207720    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-script-lib\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207755    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-volume\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207777    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207792    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-systemd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207830    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-node-log\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207865    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b369e7ad-ff3d-4a1e-9031-906027c85d2a-audit-log\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207932    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-metrics-server-audit-profiles\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207959    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b369e7ad-ff3d-4a1e-9031-906027c85d2a-audit-log\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207961    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8c63e418-061c-4f79-9d26-28fe2adba2cc-original-pull-secret\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207973    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-script-lib\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.207992    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208024    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dccn\" (UniqueName: \"kubernetes.io/projected/db75277c-76a4-4127-b5c2-d6bead6f6db2-kube-api-access-9dccn\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208044    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-kubernetes\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208077    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.208167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208088    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-kubernetes\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208171    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208255    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208301    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-wtmp\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208319    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6t9\" (UniqueName: \"kubernetes.io/projected/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-api-access-bh6t9\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208333    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-var-lib-kubelet\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208367    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208384    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7f00c4d-1310-4e08-ba66-d9720844b86f-serviceca\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208408    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208426    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208429    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-var-lib-kubelet\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208447    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208474    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-conf-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208497    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-textfile\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208522    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-conf-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208525    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208570    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-device-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.208617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208599    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cdddf29-8df1-457c-b881-e50bf4cd6898-metrics-tls\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208628    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208640    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-textfile\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208654    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-systemd\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208643    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5682428d-476a-4cd6-b4c4-a17675fea5f2-metrics-certs\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208679    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a029bb1-97b8-4018-94f9-20b06c34db89-agent-certs\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208704    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208724    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208754    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-systemd\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208746    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-hostroot\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208797    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-metrics-client-ca\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208833    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-hostroot\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208846    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpzr7\" (UniqueName: \"kubernetes.io/projected/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kube-api-access-tpzr7\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208865    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjqb\" (UniqueName: \"kubernetes.io/projected/e7473358-5d80-4235-9f4f-f72c00a84d55-kube-api-access-vhjqb\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208880    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-tls\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208920    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208927    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a029bb1-97b8-4018-94f9-20b06c34db89-agent-certs\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208947    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f00c4d-1310-4e08-ba66-d9720844b86f-host\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.208980    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-kubelet\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209005    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-ovn\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209034    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-socket-dir-parent\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209056    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-var-lib-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209098    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-socket-dir-parent\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209127    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-etc-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209128    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f7f00c4d-1310-4e08-ba66-d9720844b86f-serviceca\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209174    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92wd\" (UniqueName: \"kubernetes.io/projected/56cefe62-35cf-4953-937e-f46b87c1a928-kube-api-access-g92wd\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209194    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-client-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209208    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209238    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209264    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-dbus\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209289    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjxl\" (UniqueName: \"kubernetes.io/projected/6d02e71e-b1a9-4e13-85a2-92435ed108c6-kube-api-access-gkjxl\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209314    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-cnibin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209341    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209382    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-cnibin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209386    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.209391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209414    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-d\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209428    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-systemd-units\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209450    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209462    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209469    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209516    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-env-overrides\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209539    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209562    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209576    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-system-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209592    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9581611c-5430-475b-bd37-26c7e13b3fbd-ovn-node-metrics-cert\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209609    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209624    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cnibin\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209639    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20b4f4-576f-4153-925a-3441a17d73d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209656    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4d4w\" (UniqueName: \"kubernetes.io/projected/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-api-access-z4d4w\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209672    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209691    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-tls-assets\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209707    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209721    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-sys\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209737    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209755    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209774    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209789    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-lib-modules\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209813    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-slash\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209823    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-system-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209827    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-netd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209843    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209859    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-netns\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209872    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-sys\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209887    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-tls\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209901    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209920    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-client-certs\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209938    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4rn\" (UniqueName: \"kubernetes.io/projected/5682428d-476a-4cd6-b4c4-a17675fea5f2-kube-api-access-gj4rn\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209952    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-out\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209963    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9581611c-5430-475b-bd37-26c7e13b3fbd-ovn-node-metrics-cert\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209967    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209992    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2xk8\" (UniqueName: \"kubernetes.io/projected/1cdddf29-8df1-457c-b881-e50bf4cd6898-kube-api-access-d2xk8\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210010    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210028    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20b4f4-576f-4153-925a-3441a17d73d9-crio-socket\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210043    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-etc-kubernetes\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210060    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210081    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210096    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-config\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210112    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a029bb1-97b8-4018-94f9-20b06c34db89-konnectivity-ca\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210137    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdddf29-8df1-457c-b881-e50bf4cd6898-tmp-dir\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210151    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210170    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210186    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-kubelet\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210207    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-log-socket\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210238    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9gn\" (UniqueName: \"kubernetes.io/projected/b369e7ad-ff3d-4a1e-9031-906027c85d2a-kube-api-access-wk9gn\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210255    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.209737    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-env-overrides\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210273    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9fk5\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-kube-api-access-m9fk5\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210291    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-bin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210306    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-multus-certs\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210321    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-conf\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.210431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210406    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-lib-modules\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210622    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210669    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-etc-kubernetes\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210679    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-netns\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210765    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210844    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9581611c-5430-475b-bd37-26c7e13b3fbd-ovnkube-config\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210954    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a029bb1-97b8-4018-94f9-20b06c34db89-konnectivity-ca\") pod \"konnectivity-agent-g66m2\" (UID: \"4a029bb1-97b8-4018-94f9-20b06c34db89\") " pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210969    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-out\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.210253    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-sys\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211004    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdddf29-8df1-457c-b881-e50bf4cd6898-tmp-dir\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211065    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-kubelet\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211197    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211219    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-web-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211244    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-bin\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211258    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-registration-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211278    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cbz\" (UniqueName: \"kubernetes.io/projected/9581611c-5430-475b-bd37-26c7e13b3fbd-kube-api-access-n8cbz\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211295    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7473358-5d80-4235-9f4f-f72c00a84d55-iptables-alerter-script\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211311    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211328    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211335    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764ba139-faa5-4431-b64e-d3e0d2866470-etc-sysctl-conf\") pod \"tuned-l7ln5\" (UID: \"764ba139-faa5-4431-b64e-d3e0d2866470\") " pod="openshift-cluster-node-tuning-operator/tuned-l7ln5"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211344    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7473358-5d80-4235-9f4f-f72c00a84d55-host-slash\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211368    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211383    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211399    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56cefe62-35cf-4953-937e-f46b87c1a928-cert\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211415    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-k8s-cni-cncf-io\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211430    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-multus\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211447    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211463    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-sys-fs\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211478    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cdddf29-8df1-457c-b881-e50bf4cd6898-config-volume\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211494    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211499    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-multus-certs\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211511    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf67f\" (UniqueName: \"kubernetes.io/projected/f7f00c4d-1310-4e08-ba66-d9720844b86f-kube-api-access-vf67f\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211528    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211545    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpgf\" (UniqueName: \"kubernetes.io/projected/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-kube-api-access-5hpgf\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211576    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211597    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-kubelet-config\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211615    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w46fk\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-kube-api-access-w46fk\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211670    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211784    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-multus-cni-dir\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211839    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-run-k8s-cni-cncf-io\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.211918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.211864    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e51c4bdb-690c-4608-b2ee-ba870b79719c-host-var-lib-cni-multus\") pod \"multus-p4kbp\" (UID: \"e51c4bdb-690c-4608-b2ee-ba870b79719c\") " pod="openshift-multus/multus-p4kbp"
Oct 30 18:38:32.254284 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254049    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 18:38:32.254284 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254194    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.254544 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254370    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.254544 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254522    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 18:38:32.254544 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254530    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.254699 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254576    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 18:38:32.254735 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254711    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 18:38:32.254818 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254757    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 18:38:32.254818 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254769    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 18:38:32.254921 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254858    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.254921 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254940    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 18:38:32.255051 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254963    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 18:38:32.255051 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254981    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 18:38:32.255051 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.254991    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 18:38:32.257512 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.257494    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 18:38:32.257614 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.257603    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.257862 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.257846    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.258408 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.258392    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.258515 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.258445    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-metrics-server-audit-profiles\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.258515 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.258454    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.258737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.258723    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 18:38:32.258802 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.258784    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 18:38:32.259945 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.259913    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.260018 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.259961    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.260416 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.260379    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-tls-assets\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.260477 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.260449    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.260566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.260473    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 18:38:32.260566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.260499    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b369e7ad-ff3d-4a1e-9031-906027c85d2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.260952 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.260929    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.260993 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.260950    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.261033 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.261014    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-swgzb\""
Oct 30 18:38:32.261033 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.261022    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 18:38:32.261097 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.261056    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.261185 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.261169    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.261255 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.261173    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.262251 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.262220    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cdddf29-8df1-457c-b881-e50bf4cd6898-config-volume\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.262287 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.262247    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7473358-5d80-4235-9f4f-f72c00a84d55-iptables-alerter-script\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.263380 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.263368    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:38:32.263435 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.263425    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:38:32.263475 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.263442    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kt2wj\""
Oct 30 18:38:32.263475 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.263463    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 18:38:32.266491 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.266479    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 18:38:32.266571 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.266518    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 18:38:32.268078 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268059    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-config-volume\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268558    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268582    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268563    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268637    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268626    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268660    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-78hmw\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268727    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268722    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.268849    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269018    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269046    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269058    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269095    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f6d2v\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269096    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269155    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269192    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269201    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269241    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f25127kp2dcvt\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269256    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269279    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fqx94\""
Oct 30 18:38:32.269319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269282    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 18:38:32.270019 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269356    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 18:38:32.270019 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269520    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-tls\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.270019 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269526    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-client-ca-bundle\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.270019 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269566    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sr9st\""
Oct 30 18:38:32.270019 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269617    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7kh4z\""
Oct 30 18:38:32.270019 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.269905    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20b4f4-576f-4153-925a-3441a17d73d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.270987 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.270968    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-tls\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.271026 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.270986    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.271375 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.271359    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b369e7ad-ff3d-4a1e-9031-906027c85d2a-secret-metrics-server-client-certs\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.271487 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.271476    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.272184 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.272168    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-web-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.272184 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.272175    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.272272 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.272184    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-config\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.272272 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.272185    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.278353 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.278335    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.278449 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.278331    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/77141143-0ae3-4a7d-ba64-9bab0c3bf939-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.281716 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.278802    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.300900 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300871    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 18:38:32.300900 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300878    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 18:38:32.301050 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300895    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 18:38:32.301050 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300902    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2wwxj\""
Oct 30 18:38:32.301050 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300919    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 18:38:32.301050 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300924    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 18:38:32.301050 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.300988    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 18:38:32.302928 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.302906    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.307435 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307413    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d02e71e-b1a9-4e13-85a2-92435ed108c6-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.307517 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307451    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 18:38:32.307517 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307463    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5mui169d0e6fr\""
Oct 30 18:38:32.307517 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307473    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lfj5d\""
Oct 30 18:38:32.307517 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307491    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-m4f62\""
Oct 30 18:38:32.307652 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307517    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 18:38:32.307652 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.307535    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 18:38:32.308325 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.308305    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9gn\" (UniqueName: \"kubernetes.io/projected/b369e7ad-ff3d-4a1e-9031-906027c85d2a-kube-api-access-wk9gn\") pod \"metrics-server-c898556f7-rxxgm\" (UID: \"b369e7ad-ff3d-4a1e-9031-906027c85d2a\") " pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:32.308403 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.308305    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmdz8\" (UniqueName: \"kubernetes.io/projected/1da3b8e1-4a93-4493-b96b-d1d057f48c1c-kube-api-access-zmdz8\") pod \"network-check-target-pqztj\" (UID: \"1da3b8e1-4a93-4493-b96b-d1d057f48c1c\") " pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:32.308506 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.308486    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.308966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.308924    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cdddf29-8df1-457c-b881-e50bf4cd6898-metrics-tls\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.308966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.308942    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.309154 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309134    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd305194-b939-401e-a5d0-b0f38e8aae86-metrics-client-ca\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.309371 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309350    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.309519 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309498    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjqb\" (UniqueName: \"kubernetes.io/projected/e7473358-5d80-4235-9f4f-f72c00a84d55-kube-api-access-vhjqb\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.309612 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309537    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.309612 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309574    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.309612 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309593    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6t9\" (UniqueName: \"kubernetes.io/projected/0a8a5d1c-491a-4031-86cc-d5fbe2d07f62-kube-api-access-bh6t9\") pod \"kube-state-metrics-5dc8d7d89b-8d95l\" (UID: \"0a8a5d1c-491a-4031-86cc-d5fbe2d07f62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8d95l"
Oct 30 18:38:32.309750 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309638    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2xk8\" (UniqueName: \"kubernetes.io/projected/1cdddf29-8df1-457c-b881-e50bf4cd6898-kube-api-access-d2xk8\") pod \"dns-default-7k2jl\" (UID: \"1cdddf29-8df1-457c-b881-e50bf4cd6898\") " pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:32.309750 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309665    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 18:38:32.309750 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309729    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9fk5\" (UniqueName: \"kubernetes.io/projected/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-kube-api-access-m9fk5\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.309904 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309780    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92wd\" (UniqueName: \"kubernetes.io/projected/56cefe62-35cf-4953-937e-f46b87c1a928-kube-api-access-g92wd\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:32.309904 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.309864    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.310051 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310033    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4d4w\" (UniqueName: \"kubernetes.io/projected/4a20b4f4-576f-4153-925a-3441a17d73d9-kube-api-access-z4d4w\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.310167 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310143    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpzr7\" (UniqueName: \"kubernetes.io/projected/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kube-api-access-tpzr7\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.310244 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310182    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77141143-0ae3-4a7d-ba64-9bab0c3bf939-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.310244 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310193    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnwh\" (UniqueName: \"kubernetes.io/projected/fd305194-b939-401e-a5d0-b0f38e8aae86-kube-api-access-2mnwh\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.310343 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310293    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4rn\" (UniqueName: \"kubernetes.io/projected/5682428d-476a-4cd6-b4c4-a17675fea5f2-kube-api-access-gj4rn\") pod \"network-metrics-daemon-29tfr\" (UID: \"5682428d-476a-4cd6-b4c4-a17675fea5f2\") " pod="openshift-multus/network-metrics-daemon-29tfr"
Oct 30 18:38:32.310343 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310300    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dccn\" (UniqueName: \"kubernetes.io/projected/db75277c-76a4-4127-b5c2-d6bead6f6db2-kube-api-access-9dccn\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.310439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310387    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjxl\" (UniqueName: \"kubernetes.io/projected/6d02e71e-b1a9-4e13-85a2-92435ed108c6-kube-api-access-gkjxl\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.310439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310417    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.310439 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.310429    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc0656d-bf19-4ed8-a70c-e44afb11dea5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fdc0656d-bf19-4ed8-a70c-e44afb11dea5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:32.311253 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311216    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cbz\" (UniqueName: \"kubernetes.io/projected/9581611c-5430-475b-bd37-26c7e13b3fbd-kube-api-access-n8cbz\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.311328 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311303    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpgf\" (UniqueName: \"kubernetes.io/projected/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-kube-api-access-5hpgf\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.311373 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311349    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf67f\" (UniqueName: \"kubernetes.io/projected/f7f00c4d-1310-4e08-ba66-d9720844b86f-kube-api-access-vf67f\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.311641 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311625    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w46fk\" (UniqueName: \"kubernetes.io/projected/77141143-0ae3-4a7d-ba64-9bab0c3bf939-kube-api-access-w46fk\") pod \"alertmanager-main-0\" (UID: \"77141143-0ae3-4a7d-ba64-9bab0c3bf939\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:32.311836 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311824    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-sys-fs\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.311866 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311844    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.311866 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311861    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-kubelet-config\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.311935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311876    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-bin\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.311935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311919    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.311935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311924    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-kubelet-config\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311933    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-netns\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311957    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-bin\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311936    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-sys-fs\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311966    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-root\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312001    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-root\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.311969    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-netns\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312030 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312009    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db75277c-76a4-4127-b5c2-d6bead6f6db2-hosts-file\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312051    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56cefe62-35cf-4953-937e-f46b87c1a928-cert\") pod \"ingress-canary-jlkk2\" (UID: \"56cefe62-35cf-4953-937e-f46b87c1a928\") " pod="openshift-ingress-canary/ingress-canary-jlkk2"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312061    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312053    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db75277c-76a4-4127-b5c2-d6bead6f6db2-hosts-file\") pod \"node-resolver-hqx6v\" (UID: \"db75277c-76a4-4127-b5c2-d6bead6f6db2\") " pod="openshift-dns/node-resolver-hqx6v"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312090    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-socket-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312101    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d02e71e-b1a9-4e13-85a2-92435ed108c6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-krdfp\" (UID: \"6d02e71e-b1a9-4e13-85a2-92435ed108c6\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-krdfp"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312109    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312108    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312131    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312171    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-systemd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312177    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312189    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-node-log\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312171    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312202    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-systemd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312177    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-socket-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312259    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312274    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-node-log\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312287    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-wtmp\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.312307 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312310    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-device-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312332    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f00c4d-1310-4e08-ba66-d9720844b86f-host\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312348    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-kubelet\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312361    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-ovn\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312380    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312386    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7f00c4d-1310-4e08-ba66-d9720844b86f-host\") pod \"node-ca-wn9rz\" (UID: \"f7f00c4d-1310-4e08-ba66-d9720844b86f\") " pod="openshift-image-registry/node-ca-wn9rz"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312391    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-node-exporter-wtmp\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312406    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-var-lib-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312397    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-ovn\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312406    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-kubelet\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312421    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-device-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312438    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-etc-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312431    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-var-lib-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312475    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-etc-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312472    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-dbus\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312506    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-systemd-units\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312522    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312538    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cnibin\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312542    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-systemd-units\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312556    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312573    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-slash\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312586    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-netd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312600    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-sys\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312621    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-slash\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312622    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-run-openvswitch\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312520    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8c63e418-061c-4f79-9d26-28fe2adba2cc-dbus\") pod \"global-pull-secret-syncer-rq9kn\" (UID: \"8c63e418-061c-4f79-9d26-28fe2adba2cc\") " pod="kube-system/global-pull-secret-syncer-rq9kn"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312638    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-cni-netd\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312651    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd305194-b939-401e-a5d0-b0f38e8aae86-sys\") pod \"node-exporter-ztgh2\" (UID: \"fd305194-b939-401e-a5d0-b0f38e8aae86\") " pod="openshift-monitoring/node-exporter-ztgh2"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312629    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20b4f4-576f-4153-925a-3441a17d73d9-crio-socket\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312670    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20b4f4-576f-4153-925a-3441a17d73d9-crio-socket\") pod \"insights-runtime-extractor-nk68x\" (UID: \"4a20b4f4-576f-4153-925a-3441a17d73d9\") " pod="openshift-insights/insights-runtime-extractor-nk68x"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312602    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1148f4-6adb-46ec-96c8-d33ca9883fbd-cnibin\") pod \"multus-additional-cni-plugins-b2t2n\" (UID: \"aa1148f4-6adb-46ec-96c8-d33ca9883fbd\") " pod="openshift-multus/multus-additional-cni-plugins-b2t2n"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312682    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-log-socket\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312624    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312709    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-registration-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312731    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7473358-5d80-4235-9f4f-f72c00a84d55-host-slash\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312730    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9581611c-5430-475b-bd37-26c7e13b3fbd-log-socket\") pod \"ovnkube-node-fvgxt\" (UID: \"9581611c-5430-475b-bd37-26c7e13b3fbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312777    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7473358-5d80-4235-9f4f-f72c00a84d55-host-slash\") pod \"iptables-alerter-fckwv\" (UID: \"e7473358-5d80-4235-9f4f-f72c00a84d55\") " pod="openshift-network-operator/iptables-alerter-fckwv"
Oct 30 18:38:32.312935 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:32.312785    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15f9c425-4dc6-48c2-9db0-11dc60b2d1c5-registration-dir\") pod \"aws-ebs-csi-driver-node-kd8zj\" (UID: \"15f9c425-4dc6-48c2-9db0-11dc60b2d1c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd8zj"
Oct 30 18:38:33.711050 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:33.711013    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:33.730294 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:33.730267    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:34.016104 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:34.016037    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7k2jl"
Oct 30 18:38:34.644434 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:34.644400    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:35.598190 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:35.598160    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g66m2"
Oct 30 18:38:36.216727 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:36.216691    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:36.539406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:36.539324    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:38.710342 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:38.710308    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:38:40.226508 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:40.226473    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:40.226966 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:40.226678    5652 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 18:38:40.602335 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:40.602303    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:40.820729 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:38:40.820658    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:38:41.669809 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:41.669783    5652 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-244.us-west-2.compute.internal" event="NodeReady"
Oct 30 18:38:51.098515 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:51.098482    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fvgxt"
Oct 30 18:38:52.454370 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:52.454325    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:52.668743 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:52.668691    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:54.569097 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:54.569067    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c898556f7-rxxgm"
Oct 30 18:38:57.863989 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:57.863955    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:38:58.105341 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:38:58.105309    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:00.801540 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:00.801508    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:01.110048 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:01.110015    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:08.713005 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:08.712974    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pqztj"
Oct 30 18:39:10.820584 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:39:10.820548    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:39:12.274135 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:12.274099    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:12.547177 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:12.547093    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:12.775806 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:12.775762    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:16.651174 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:16.651138    5652 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:39:28.375133 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:28.375091    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:40.821337 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:39:40.821298    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:39:41.519268 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:41.519215    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:39:42.478645 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:39:42.478613    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:07.453959 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:07.453926    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:08.529291 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:08.529260    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:10.820935 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:40:10.820865    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:40:16.667427 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:16.667399    5652 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:40:18.407895 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:18.407858    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:28.651803 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:28.651772    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:30.193686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:30.193652    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:31.094160 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:31.094129    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:31.275764 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:31.275736    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:40.821616 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:40:40.821576    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:40:42.024494 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:42.024452    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:42.214909 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:42.214837    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:43.396035 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:43.395983    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:43.650910 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:43.650835    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:45.069450 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:45.069422    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:40:45.252294 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:40:45.252260    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:41:07.273383 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:41:07.273346    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:41:10.820677 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:41:10.820640    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:41:28.988242 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:41:28.988173    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:41:40.820749 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:41:40.820673    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:41:43.748807 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:41:43.748760    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:42:10.820134 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:42:10.820089    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:42:29.346547 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:42:29.346499    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:42:40.820854 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:42:40.820815    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:43:10.820826 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:43:10.820735    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:43:26.376123 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:26.376080    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:43:26.571341 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:26.571311    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:43:29.700891 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:29.700861    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:43:40.821959 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:43:40.821920    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:43:41.068174 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:41.068143    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:43:41.258093 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:41.258027    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:43:59.360984 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:59.360953    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:43:59.556977 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:43:59.556947    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:04.257418 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:04.257374    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:04.467383 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:04.467335    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:10.820397 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:44:10.820361    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:44:11.561507 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:11.561476    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:13.313093 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:13.313063    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:13.514102 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:13.514073    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:14.875356 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:14.875315    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:15.092530 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:15.092497    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:15.374936 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:15.374907    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:15.601360 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:15.601328    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:15.793270 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:15.793164    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:17.828299 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:17.828255    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:18.786448 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:18.786390    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:19.292623 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:19.292588    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:19.499554 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:19.499524    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:30.012397 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:44:30.012360    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:44:40.820923 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:44:40.820839    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:45:03.002592 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:03.002527    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:03.979939 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:03.979891    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:04.176692 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:04.176663    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:04.509120 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:04.509064    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:10.824076 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:45:10.824033    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:45:30.355534 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:30.355504    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:40.820160 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:45:40.820117    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:45:55.794817 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:55.794782    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:59.706796 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.706761    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:59.897765 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.897730    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-8f9s2"]
Oct 30 18:45:59.903345 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.901872    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:45:59.903345 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.903157    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:45:59.962455 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.962395    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-8f9s2"]
Oct 30 18:45:59.997700 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.997678    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Oct 30 18:45:59.997839 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.997703    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 18:45:59.997839 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.997743    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 18:45:59.997839 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:45:59.997803    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vvjb4\""
Oct 30 18:46:00.018961 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.018937    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5a656d5-6f1e-4098-86c2-3a9f3e537015-data\") pod \"seaweedfs-78bb9c6ff8-8f9s2\" (UID: \"c5a656d5-6f1e-4098-86c2-3a9f3e537015\") " pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.019059 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.018969    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqljv\" (UniqueName: \"kubernetes.io/projected/c5a656d5-6f1e-4098-86c2-3a9f3e537015-kube-api-access-dqljv\") pod \"seaweedfs-78bb9c6ff8-8f9s2\" (UID: \"c5a656d5-6f1e-4098-86c2-3a9f3e537015\") " pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.100840 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.100814    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:00.119942 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.119921    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5a656d5-6f1e-4098-86c2-3a9f3e537015-data\") pod \"seaweedfs-78bb9c6ff8-8f9s2\" (UID: \"c5a656d5-6f1e-4098-86c2-3a9f3e537015\") " pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.120008 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.119955    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqljv\" (UniqueName: \"kubernetes.io/projected/c5a656d5-6f1e-4098-86c2-3a9f3e537015-kube-api-access-dqljv\") pod \"seaweedfs-78bb9c6ff8-8f9s2\" (UID: \"c5a656d5-6f1e-4098-86c2-3a9f3e537015\") " pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.120374 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.120358    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5a656d5-6f1e-4098-86c2-3a9f3e537015-data\") pod \"seaweedfs-78bb9c6ff8-8f9s2\" (UID: \"c5a656d5-6f1e-4098-86c2-3a9f3e537015\") " pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.177240 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.177204    5652 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 18:46:00.179356 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.179334    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqljv\" (UniqueName: \"kubernetes.io/projected/c5a656d5-6f1e-4098-86c2-3a9f3e537015-kube-api-access-dqljv\") pod \"seaweedfs-78bb9c6ff8-8f9s2\" (UID: \"c5a656d5-6f1e-4098-86c2-3a9f3e537015\") " pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.213313 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.213268    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:00.575566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.575540    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-8f9s2"]
Oct 30 18:46:00.578984 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:46:00.578952    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a656d5_6f1e_4098_86c2_3a9f3e537015.slice/crio-751a98d707184b47654a378d1af42f5f0424bf5d4302e9353fdfed2085ec8007 WatchSource:0}: Error finding container 751a98d707184b47654a378d1af42f5f0424bf5d4302e9353fdfed2085ec8007: Status 404 returned error can't find the container with id 751a98d707184b47654a378d1af42f5f0424bf5d4302e9353fdfed2085ec8007
Oct 30 18:46:00.580534 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.580517    5652 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 18:46:00.603247 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:00.603199    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2" event={"ID":"c5a656d5-6f1e-4098-86c2-3a9f3e537015","Type":"ContainerStarted","Data":"751a98d707184b47654a378d1af42f5f0424bf5d4302e9353fdfed2085ec8007"}
Oct 30 18:46:01.300058 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:01.300029    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:01.489216 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:01.489133    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:01.694295 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:01.694260    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:03.616289 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:03.616259    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2" event={"ID":"c5a656d5-6f1e-4098-86c2-3a9f3e537015","Type":"ContainerStarted","Data":"6a335d5c1978a997279d2ea2ed1d2dc4a10a8ec63bc166b5a52a072b243767a7"}
Oct 30 18:46:03.616656 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:03.616362    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:03.727666 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:03.727617    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2" podStartSLOduration=1.7670751139999998 podStartE2EDuration="4.727604002s" totalImagesPullingTime="2.960528888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:46:03.726785451 +0000 UTC m=+452.807455825" watchObservedRunningTime="2026-10-30 18:46:03.727604002 +0000 UTC m=+452.808274376"
Oct 30 18:46:09.621609 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:09.621580    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-8f9s2"
Oct 30 18:46:10.000125 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:10.000040    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:10.216647 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:10.216616    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:10.820411 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:46:10.820330    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:46:30.816482 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:46:30.816449    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:46:40.820689 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:46:40.820656    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:47:10.820469 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:47:10.820432    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:47:31.069357 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:31.069326    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:34.887358 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:34.887322    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:35.088594 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:35.088565    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:35.288212 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:35.288111    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:35.479835 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:35.479801    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:39.697218 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:39.697180    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:39.887246 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:39.887202    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:47:40.819846 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:47:40.819776    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:47:52.450476 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.450442    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/s3-init-qnzz8"]
Oct 30 18:47:52.453551 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.453534    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.504472 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.504451    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Oct 30 18:47:52.526600 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.526580    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache\") pod \"s3-init-qnzz8\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") " pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.526704 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.526613    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dq6d\" (UniqueName: \"kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d\") pod \"s3-init-qnzz8\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") " pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.549613 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.549584    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qnzz8"]
Oct 30 18:47:52.627456 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.627416    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache\") pod \"s3-init-qnzz8\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") " pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.627545 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.627466    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dq6d\" (UniqueName: \"kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d\") pod \"s3-init-qnzz8\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") " pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.627753 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.627735    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache\") pod \"s3-init-qnzz8\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") " pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.686799 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.686779    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dq6d\" (UniqueName: \"kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d\") pod \"s3-init-qnzz8\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") " pod="kserve/s3-init-qnzz8"
Oct 30 18:47:52.777887 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:52.777832    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qnzz8"
Oct 30 18:47:53.142981 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:53.142951    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qnzz8"]
Oct 30 18:47:53.146758 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:47:53.146729    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb22273e_bf87_493a_8bfe_bcccd4c56c07.slice/crio-6cd02441de7ca2e2efe1852d15cfcfcbcdc4e29029cc3cb68aca95aaa288eb82 WatchSource:0}: Error finding container 6cd02441de7ca2e2efe1852d15cfcfcbcdc4e29029cc3cb68aca95aaa288eb82: Status 404 returned error can't find the container with id 6cd02441de7ca2e2efe1852d15cfcfcbcdc4e29029cc3cb68aca95aaa288eb82
Oct 30 18:47:53.991665 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:47:53.991626    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qnzz8" event={"ID":"bb22273e-bf87-493a-8bfe-bcccd4c56c07","Type":"ContainerStarted","Data":"6cd02441de7ca2e2efe1852d15cfcfcbcdc4e29029cc3cb68aca95aaa288eb82"}
Oct 30 18:48:03.030401 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:03.030365    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qnzz8" event={"ID":"bb22273e-bf87-493a-8bfe-bcccd4c56c07","Type":"ContainerStarted","Data":"1f033db16ff6c189952279935903638f566d13397349cb203b892657788301db"}
Oct 30 18:48:05.040509 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:05.040472    5652 generic.go:356] "Generic (PLEG): container finished" podID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerID="1f033db16ff6c189952279935903638f566d13397349cb203b892657788301db" exitCode=0
Oct 30 18:48:05.040984 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:05.040549    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qnzz8" event={"ID":"bb22273e-bf87-493a-8bfe-bcccd4c56c07","Type":"ContainerDied","Data":"1f033db16ff6c189952279935903638f566d13397349cb203b892657788301db"}
Oct 30 18:48:10.064409 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:10.064371    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qnzz8" event={"ID":"bb22273e-bf87-493a-8bfe-bcccd4c56c07","Type":"ContainerStarted","Data":"e0784244db340cf953239d2100c9cf8cb02f48a52981e52a90a9ab3670df8143"}
Oct 30 18:48:10.175655 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:10.175549    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/s3-init-qnzz8" podStartSLOduration=2.33212742 podStartE2EDuration="18.175531033s" totalImagesPullingTime="14.180475003s" totalInitContainerRuntime="1.66292861s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:47:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:48:10.175449172 +0000 UTC m=+579.256119547" watchObservedRunningTime="2026-10-30 18:48:10.175531033 +0000 UTC m=+579.256201407"
Oct 30 18:48:10.821617 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:48:10.821575    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:48:21.756043 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:21.756006    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:48:21.946822 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:21.946794    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:48:31.369916 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:48:31.369882    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:48:40.821564 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:48:40.821514    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:49:10.820635 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:49:10.820556    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:49:15.283685 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:15.283610    5652 generic.go:356] "Generic (PLEG): container finished" podID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerID="e0784244db340cf953239d2100c9cf8cb02f48a52981e52a90a9ab3670df8143" exitCode=0
Oct 30 18:49:15.284056 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:15.283684    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qnzz8" event={"ID":"bb22273e-bf87-493a-8bfe-bcccd4c56c07","Type":"ContainerDied","Data":"e0784244db340cf953239d2100c9cf8cb02f48a52981e52a90a9ab3670df8143"}
Oct 30 18:49:16.408217 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.408194    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qnzz8"
Oct 30 18:49:16.471583 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.471556    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache\") pod \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") "
Oct 30 18:49:16.471702 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.471689    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d\" (UniqueName: \"kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d\") pod \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\" (UID: \"bb22273e-bf87-493a-8bfe-bcccd4c56c07\") "
Oct 30 18:49:16.473736 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.473710    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d" pod "bb22273e-bf87-493a-8bfe-bcccd4c56c07" (UID: "bb22273e-bf87-493a-8bfe-bcccd4c56c07"). InnerVolumeSpecName "kube-api-access-8dq6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:49:16.490406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.490380    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache" pod "bb22273e-bf87-493a-8bfe-bcccd4c56c07" (UID: "bb22273e-bf87-493a-8bfe-bcccd4c56c07"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:49:16.572703 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.572682    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dq6d\" (UniqueName: \"kubernetes.io/projected/bb22273e-bf87-493a-8bfe-bcccd4c56c07-kube-api-access-8dq6d\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:49:16.572703 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:16.572705    5652 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb22273e-bf87-493a-8bfe-bcccd4c56c07-model-cache\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:49:17.292015 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:17.291992    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qnzz8"
Oct 30 18:49:17.292172 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:17.291986    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qnzz8" event={"ID":"bb22273e-bf87-493a-8bfe-bcccd4c56c07","Type":"ContainerDied","Data":"6cd02441de7ca2e2efe1852d15cfcfcbcdc4e29029cc3cb68aca95aaa288eb82"}
Oct 30 18:49:17.292172 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:17.292106    5652 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cd02441de7ca2e2efe1852d15cfcfcbcdc4e29029cc3cb68aca95aaa288eb82"
Oct 30 18:49:28.107214 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:28.107168    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:28.291159 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:28.291134    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:31.691469 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:31.691430    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:40.822388 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:49:40.822349    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:49:54.707615 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:54.707583    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:54.897274 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:54.897237    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:58.354319 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:58.354287    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:58.708671 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:58.708594    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:59.017074 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.016998    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:59.148023 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.147995    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"]
Oct 30 18:49:59.148298 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.148286    5652 cpu_manager.go:414] "containerMap: removing container" podUID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerName="download-hf-model"
Oct 30 18:49:59.148347 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.148300    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerName="download-hf-model"
Oct 30 18:49:59.148347 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.148313    5652 cpu_manager.go:414] "containerMap: removing container" podUID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerName="s3-init"
Oct 30 18:49:59.148347 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.148320    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerName="s3-init"
Oct 30 18:49:59.148476 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.148366    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb22273e-bf87-493a-8bfe-bcccd4c56c07" containerName="s3-init"
Oct 30 18:49:59.151066 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.151052    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.247350 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247326    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:49:59.247510 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247452    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"kube-root-ca.crt\""
Oct 30 18:49:59.247586 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247524    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"seaweedfs-s3-creds\""
Oct 30 18:49:59.247586 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247534    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"openshift-service-ca.crt\""
Oct 30 18:49:59.247586 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247537    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-rollback-v2-predictor-serving-cert\""
Oct 30 18:49:59.247586 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247581    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Oct 30 18:49:59.247774 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.247629    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"default-dockercfg-zc4kv\""
Oct 30 18:49:59.249437 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.249413    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"]
Oct 30 18:49:59.278548 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.278497    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.278548 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.278527    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k4j4\" (UniqueName: \"kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.278705 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.278549    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.278705 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.278572    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.278785 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.278715    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.379402 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.379374    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.379402 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.379405    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k4j4\" (UniqueName: \"kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.379861 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.379426    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.379861 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.379463    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.379861 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.379493    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.379861 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.379842    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.380336 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.380306    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.380464 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.380309    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.381787 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.381768    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.383995 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.383975    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:49:59.438878 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.438854    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k4j4\" (UniqueName: \"kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4\") pod \"isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.466703 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.466678    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:49:59.583808 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.583783    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"]
Oct 30 18:49:59.587059 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.587043    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.639988 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.639967    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-rollback-predictor-serving-cert\""
Oct 30 18:49:59.644788 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.644767    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"]
Oct 30 18:49:59.682760 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.682738    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xrx\" (UniqueName: \"kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.682881 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.682773    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.682958 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.682896    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.682958 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.682934    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.683066 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.683018    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.783937 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.783907    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784197 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.783950    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784197 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.783994    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xrx\" (UniqueName: \"kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784197 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.784014    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784197 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.784056    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784447 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.784419    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784729 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.784711    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.784768 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.784721    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.786395 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.786377    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.843999 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.843951    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xrx\" (UniqueName: \"kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx\") pod \"isvc-canary-rollback-predictor-554c7cc56d-lc76k\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:49:59.883409 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.883384    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"]
Oct 30 18:49:59.886719 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:49:59.886696    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bc47e8_bed1_4f11_8c27_ea945057dfb2.slice/crio-93db26f39ace1d40f9e3c5b89fa9fb9069d00f902d60a721a7c8f44d4cd4c459 WatchSource:0}: Error finding container 93db26f39ace1d40f9e3c5b89fa9fb9069d00f902d60a721a7c8f44d4cd4c459: Status 404 returned error can't find the container with id 93db26f39ace1d40f9e3c5b89fa9fb9069d00f902d60a721a7c8f44d4cd4c459
Oct 30 18:49:59.902828 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:49:59.902808    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:50:00.314850 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:00.314820    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"]
Oct 30 18:50:00.318403 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:50:00.318375    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc003ab47_cd03_4101_ad60_f970488f9da6.slice/crio-9aae6addd6f636cdb8c84538651f8f02b353e5869f7efaf5f03fe15dafc32f60 WatchSource:0}: Error finding container 9aae6addd6f636cdb8c84538651f8f02b353e5869f7efaf5f03fe15dafc32f60: Status 404 returned error can't find the container with id 9aae6addd6f636cdb8c84538651f8f02b353e5869f7efaf5f03fe15dafc32f60
Oct 30 18:50:00.438671 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:00.438635    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerStarted","Data":"21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4"}
Oct 30 18:50:00.439112 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:00.438714    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerStarted","Data":"93db26f39ace1d40f9e3c5b89fa9fb9069d00f902d60a721a7c8f44d4cd4c459"}
Oct 30 18:50:00.440296 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:00.440269    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerStarted","Data":"19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113"}
Oct 30 18:50:00.440414 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:00.440328    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerStarted","Data":"9aae6addd6f636cdb8c84538651f8f02b353e5869f7efaf5f03fe15dafc32f60"}
Oct 30 18:50:04.455471 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:04.455436    5652 generic.go:356] "Generic (PLEG): container finished" podID="c003ab47-cd03-4101-ad60-f970488f9da6" containerID="19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113" exitCode=0
Oct 30 18:50:04.455830 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:04.455510    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerDied","Data":"19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113"}
Oct 30 18:50:04.457203 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:04.457174    5652 generic.go:356] "Generic (PLEG): container finished" podID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerID="21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4" exitCode=0
Oct 30 18:50:04.457334 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:04.457205    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerDied","Data":"21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4"}
Oct 30 18:50:10.866514 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:50:10.866466    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:50:25.563201 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:25.563169    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerStarted","Data":"59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba"}
Oct 30 18:50:26.570941 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:26.570904    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerStarted","Data":"8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86"}
Oct 30 18:50:28.581298 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:28.581269    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerStarted","Data":"f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1"}
Oct 30 18:50:28.581639 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:28.581489    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:50:28.581639 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:28.581629    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:50:28.582825 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:28.582788    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:50:28.711116 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:28.711073    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podStartSLOduration=1.79559369 podStartE2EDuration="29.711060066s" totalImagesPullingTime="23.894120929s" totalInitContainerRuntime="4.021345447s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:49:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:50:28.710114464 +0000 UTC m=+717.790784837" watchObservedRunningTime="2026-10-30 18:50:28.711060066 +0000 UTC m=+717.791730441"
Oct 30 18:50:29.587258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:29.587201    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerStarted","Data":"9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde"}
Oct 30 18:50:29.587709 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:29.587338    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:50:29.587709 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:29.587396    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:50:29.587709 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:29.587515    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:50:29.588766 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:29.588738    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:50:29.747399 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:29.747340    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podStartSLOduration=2.643075245 podStartE2EDuration="30.747322372s" totalImagesPullingTime="24.193751231s" totalInitContainerRuntime="3.910495896s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:49:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:50:29.746831488 +0000 UTC m=+718.827501864" watchObservedRunningTime="2026-10-30 18:50:29.747322372 +0000 UTC m=+718.827992747"
Oct 30 18:50:30.591578 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:30.591529    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:50:32.039284 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:32.039256    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:50:34.592185 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:34.592156    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:50:34.592625 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:34.592603    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:50:35.596166 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:35.596137    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:50:35.596744 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:35.596717    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:50:40.821712 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:50:40.821625    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:50:44.593091 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:44.593047    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:50:45.597477 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:45.597437    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:50:54.592851 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:54.592817    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:50:55.596654 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:50:55.596610    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:51:04.593312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:04.593275    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:51:05.597125 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:05.597080    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:51:10.820864 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:51:10.820828    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:51:14.593113 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:14.593075    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:51:15.597355 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:15.597316    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:51:24.593458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:24.593412    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:51:25.596659 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:25.596616    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:51:32.356406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:32.356357    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:51:34.593054 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:34.593014    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.16:8080: connect: connection refused"
Oct 30 18:51:35.597536 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:35.597495    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:51:40.819772 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:51:40.819734    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:51:41.035084 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:41.035040    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused"
Oct 30 18:51:44.593382 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:44.593349    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:51:46.047205 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:46.047176    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"]
Oct 30 18:51:46.047694 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:46.047439    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container" containerID="cri-o://8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86" gracePeriod=30
Oct 30 18:51:46.047694 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:46.047456    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kube-rbac-proxy" containerID="cri-o://9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde" gracePeriod=30
Oct 30 18:51:46.048314 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:46.048295    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:51:46.867274 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:46.867218    5652 generic.go:356] "Generic (PLEG): container finished" podID="c003ab47-cd03-4101-ad60-f970488f9da6" containerID="9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde" exitCode=0
Oct 30 18:51:46.867274 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:46.867263    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerDied","Data":"9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde"}
Oct 30 18:51:50.385911 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.385881    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:51:50.515404 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515350    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location\") pod \"c003ab47-cd03-4101-ad60-f970488f9da6\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") "
Oct 30 18:51:50.515520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515408    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx\" (UniqueName: \"kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx\") pod \"c003ab47-cd03-4101-ad60-f970488f9da6\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") "
Oct 30 18:51:50.515520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515441    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config\") pod \"c003ab47-cd03-4101-ad60-f970488f9da6\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") "
Oct 30 18:51:50.515520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515474    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert\") pod \"c003ab47-cd03-4101-ad60-f970488f9da6\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") "
Oct 30 18:51:50.515520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515516    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls\" (UniqueName: \"kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls\") pod \"c003ab47-cd03-4101-ad60-f970488f9da6\" (UID: \"c003ab47-cd03-4101-ad60-f970488f9da6\") "
Oct 30 18:51:50.515718 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515698    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location" pod "c003ab47-cd03-4101-ad60-f970488f9da6" (UID: "c003ab47-cd03-4101-ad60-f970488f9da6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:51:50.515820 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515795    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c003ab47-cd03-4101-ad60-f970488f9da6-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:51:50.515942 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515842    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config" pod "c003ab47-cd03-4101-ad60-f970488f9da6" (UID: "c003ab47-cd03-4101-ad60-f970488f9da6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:51:50.515942 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.515893    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert" pod "c003ab47-cd03-4101-ad60-f970488f9da6" (UID: "c003ab47-cd03-4101-ad60-f970488f9da6"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:51:50.517772 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.517750    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls" pod "c003ab47-cd03-4101-ad60-f970488f9da6" (UID: "c003ab47-cd03-4101-ad60-f970488f9da6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:51:50.517963 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.517904    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx" pod "c003ab47-cd03-4101-ad60-f970488f9da6" (UID: "c003ab47-cd03-4101-ad60-f970488f9da6"). InnerVolumeSpecName "kube-api-access-b2xrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:51:50.616567 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.616544    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2xrx\" (UniqueName: \"kubernetes.io/projected/c003ab47-cd03-4101-ad60-f970488f9da6-kube-api-access-b2xrx\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:51:50.616567 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.616566    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:51:50.616709 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.616578    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c003ab47-cd03-4101-ad60-f970488f9da6-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:51:50.616709 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.616590    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c003ab47-cd03-4101-ad60-f970488f9da6-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:51:50.885139 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.885099    5652 generic.go:356] "Generic (PLEG): container finished" podID="c003ab47-cd03-4101-ad60-f970488f9da6" containerID="8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86" exitCode=0
Oct 30 18:51:50.885312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.885157    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"
Oct 30 18:51:50.885312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.885167    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerDied","Data":"8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86"}
Oct 30 18:51:50.885312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.885240    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k" event={"ID":"c003ab47-cd03-4101-ad60-f970488f9da6","Type":"ContainerDied","Data":"9aae6addd6f636cdb8c84538651f8f02b353e5869f7efaf5f03fe15dafc32f60"}
Oct 30 18:51:50.885312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.885268    5652 scope.go:122] "RemoveContainer" containerID="9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde"
Oct 30 18:51:50.894020 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.894006    5652 scope.go:122] "RemoveContainer" containerID="8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86"
Oct 30 18:51:50.901218 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.901200    5652 scope.go:122] "RemoveContainer" containerID="19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113"
Oct 30 18:51:50.907940 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.907922    5652 scope.go:122] "RemoveContainer" containerID="9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde"
Oct 30 18:51:50.908236 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:51:50.908202    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde\": container with ID starting with 9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde not found: ID does not exist" containerID="9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde"
Oct 30 18:51:50.908323 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.908253    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde"} err="failed to get container status \"9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde\": rpc error: code = NotFound desc = could not find container \"9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde\": container with ID starting with 9a9d20b7e478a77818de472998d8ad88e2942679d01313d7abd4f74fd4b55bde not found: ID does not exist"
Oct 30 18:51:50.908323 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.908303    5652 scope.go:122] "RemoveContainer" containerID="8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86"
Oct 30 18:51:50.908578 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:51:50.908562    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86\": container with ID starting with 8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86 not found: ID does not exist" containerID="8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86"
Oct 30 18:51:50.908617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.908584    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86"} err="failed to get container status \"8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86\": rpc error: code = NotFound desc = could not find container \"8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86\": container with ID starting with 8aedca33afcf96fc17c778e18245a3b8f156d52787403fe839d041f0630f3d86 not found: ID does not exist"
Oct 30 18:51:50.908617 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.908599    5652 scope.go:122] "RemoveContainer" containerID="19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113"
Oct 30 18:51:50.908813 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:51:50.908797    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113\": container with ID starting with 19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113 not found: ID does not exist" containerID="19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113"
Oct 30 18:51:50.908858 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:50.908833    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113"} err="failed to get container status \"19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113\": rpc error: code = NotFound desc = could not find container \"19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113\": container with ID starting with 19da9db744236fcf25923312c85ea00f17290d759218c5756167264d98355113 not found: ID does not exist"
Oct 30 18:51:51.043242 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:51.043202    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"]
Oct 30 18:51:51.089361 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:51.089338    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-lc76k"]
Oct 30 18:51:53.037917 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:53.037883    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" path="/var/lib/kubelet/pods/c003ab47-cd03-4101-ad60-f970488f9da6/volumes"
Oct 30 18:51:58.642165 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:58.642132    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"]
Oct 30 18:51:58.642564 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:58.642406    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container" containerID="cri-o://59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba" gracePeriod=30
Oct 30 18:51:58.642564 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:58.642426    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kube-rbac-proxy" containerID="cri-o://f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1" gracePeriod=30
Oct 30 18:51:58.833646 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:58.833615    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:51:58.918951 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:58.918891    5652 generic.go:356] "Generic (PLEG): container finished" podID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerID="f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1" exitCode=0
Oct 30 18:51:58.919055 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:58.918962    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerDied","Data":"f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1"}
Oct 30 18:51:59.220196 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220128    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"]
Oct 30 18:51:59.220454 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220439    5652 cpu_manager.go:414] "containerMap: removing container" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="storage-initializer"
Oct 30 18:51:59.220528 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220455    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="storage-initializer"
Oct 30 18:51:59.220528 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220487    5652 cpu_manager.go:414] "containerMap: removing container" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container"
Oct 30 18:51:59.220528 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220493    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container"
Oct 30 18:51:59.220528 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220506    5652 cpu_manager.go:414] "containerMap: removing container" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kube-rbac-proxy"
Oct 30 18:51:59.220528 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220510    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kube-rbac-proxy"
Oct 30 18:51:59.220703 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220563    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kserve-container"
Oct 30 18:51:59.220703 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.220572    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="c003ab47-cd03-4101-ad60-f970488f9da6" containerName="kube-rbac-proxy"
Oct 30 18:51:59.223594 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.223578    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.275171 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.275148    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-rollback-predictor-serving-cert\""
Oct 30 18:51:59.278491 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.278474    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.278554 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.278509    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.278632 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.278612    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4c6k\" (UniqueName: \"kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.278673 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.278650    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.278711 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.278678    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.291513 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.291491    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"]
Oct 30 18:51:59.379464 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.379441    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.379566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.379485    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.379566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.379539    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4c6k\" (UniqueName: \"kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.379566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.379561    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.379676 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.379577    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.379945 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.379924    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.380219 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.380200    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.383210 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.380245    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.385676 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.385623    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.439573 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.439545    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4c6k\" (UniqueName: \"kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k\") pod \"isvc-canary-rollback-predictor-554c7cc56d-4v44c\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") " pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.539241 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.539163    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:51:59.588334 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.587645    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.16:8643/healthz\": dial tcp 10.134.0.16:8643: connect: connection refused"
Oct 30 18:51:59.949951 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:51:59.949920    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"]
Oct 30 18:51:59.953319 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:51:59.953281    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17d9b11_f905_4395_b40f_ea5e35f4709f.slice/crio-5671b8577f8a6bc04ba9dbb3bf09420e5838c0bde09c73669446ee1dbd42182f WatchSource:0}: Error finding container 5671b8577f8a6bc04ba9dbb3bf09420e5838c0bde09c73669446ee1dbd42182f: Status 404 returned error can't find the container with id 5671b8577f8a6bc04ba9dbb3bf09420e5838c0bde09c73669446ee1dbd42182f
Oct 30 18:52:00.927979 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:00.927934    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerStarted","Data":"ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2"}
Oct 30 18:52:00.928171 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:00.928000    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerStarted","Data":"5671b8577f8a6bc04ba9dbb3bf09420e5838c0bde09c73669446ee1dbd42182f"}
Oct 30 18:52:03.178770 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.178747    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:52:03.208901 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.208878    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert\") pod \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") "
Oct 30 18:52:03.209017 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.208967    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4\" (UniqueName: \"kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4\") pod \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") "
Oct 30 18:52:03.209081 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209033    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls\" (UniqueName: \"kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls\") pod \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") "
Oct 30 18:52:03.209081 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209066    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config\") pod \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") "
Oct 30 18:52:03.209186 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209101    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location\") pod \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\" (UID: \"04bc47e8-bed1-4f11-8c27-ea945057dfb2\") "
Oct 30 18:52:03.209256 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209217    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert" pod "04bc47e8-bed1-4f11-8c27-ea945057dfb2" (UID: "04bc47e8-bed1-4f11-8c27-ea945057dfb2"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:52:03.209395 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209380    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:52:03.209441 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209418    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config" pod "04bc47e8-bed1-4f11-8c27-ea945057dfb2" (UID: "04bc47e8-bed1-4f11-8c27-ea945057dfb2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:52:03.209517 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.209446    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location" pod "04bc47e8-bed1-4f11-8c27-ea945057dfb2" (UID: "04bc47e8-bed1-4f11-8c27-ea945057dfb2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:52:03.210848 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.210831    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4" pod "04bc47e8-bed1-4f11-8c27-ea945057dfb2" (UID: "04bc47e8-bed1-4f11-8c27-ea945057dfb2"). InnerVolumeSpecName "kube-api-access-9k4j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:52:03.210953 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.210937    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls" pod "04bc47e8-bed1-4f11-8c27-ea945057dfb2" (UID: "04bc47e8-bed1-4f11-8c27-ea945057dfb2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:52:03.309995 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.309965    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k4j4\" (UniqueName: \"kubernetes.io/projected/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-api-access-9k4j4\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:52:03.309995 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.309990    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/04bc47e8-bed1-4f11-8c27-ea945057dfb2-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:52:03.309995 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.310000    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:52:03.310163 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.310010    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/04bc47e8-bed1-4f11-8c27-ea945057dfb2-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:52:03.941973 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.941937    5652 generic.go:356] "Generic (PLEG): container finished" podID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerID="59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba" exitCode=0
Oct 30 18:52:03.942140 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.942004    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"
Oct 30 18:52:03.942140 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.942024    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerDied","Data":"59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba"}
Oct 30 18:52:03.942140 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.942104    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb" event={"ID":"04bc47e8-bed1-4f11-8c27-ea945057dfb2","Type":"ContainerDied","Data":"93db26f39ace1d40f9e3c5b89fa9fb9069d00f902d60a721a7c8f44d4cd4c459"}
Oct 30 18:52:03.942345 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.942142    5652 scope.go:122] "RemoveContainer" containerID="f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1"
Oct 30 18:52:03.950262 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.950239    5652 scope.go:122] "RemoveContainer" containerID="59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba"
Oct 30 18:52:03.956976 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.956959    5652 scope.go:122] "RemoveContainer" containerID="21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4"
Oct 30 18:52:03.964788 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.964771    5652 scope.go:122] "RemoveContainer" containerID="f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1"
Oct 30 18:52:03.965061 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:52:03.965043    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1\": container with ID starting with f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1 not found: ID does not exist" containerID="f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1"
Oct 30 18:52:03.965117 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.965070    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1"} err="failed to get container status \"f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1\": rpc error: code = NotFound desc = could not find container \"f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1\": container with ID starting with f565a9aec46630bf3513734bb119b75d0e066cba15eb5ab381b80bf43c0510b1 not found: ID does not exist"
Oct 30 18:52:03.965117 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.965086    5652 scope.go:122] "RemoveContainer" containerID="59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba"
Oct 30 18:52:03.965334 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:52:03.965319    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba\": container with ID starting with 59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba not found: ID does not exist" containerID="59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba"
Oct 30 18:52:03.965386 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.965338    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba"} err="failed to get container status \"59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba\": rpc error: code = NotFound desc = could not find container \"59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba\": container with ID starting with 59ad51a8de13bf7979671b940803cddcecbdb824ca2a8e58770b32cee29f5bba not found: ID does not exist"
Oct 30 18:52:03.965386 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.965351    5652 scope.go:122] "RemoveContainer" containerID="21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4"
Oct 30 18:52:03.965599 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:52:03.965584    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4\": container with ID starting with 21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4 not found: ID does not exist" containerID="21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4"
Oct 30 18:52:03.965641 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:03.965602    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4"} err="failed to get container status \"21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4\": rpc error: code = NotFound desc = could not find container \"21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4\": container with ID starting with 21465e8112e107966afddb9e47960a6b2a27dce68aa06a0364bf0bc1bae2c6e4 not found: ID does not exist"
Oct 30 18:52:04.144289 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:04.144263    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"]
Oct 30 18:52:04.190158 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:04.190127    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-v2-predictor-7d75d9cd85-krggb"]
Oct 30 18:52:04.947820 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:04.947789    5652 generic.go:356] "Generic (PLEG): container finished" podID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerID="ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2" exitCode=0
Oct 30 18:52:04.947990 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:04.947851    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerDied","Data":"ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2"}
Oct 30 18:52:05.038691 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:05.038665    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" path="/var/lib/kubelet/pods/04bc47e8-bed1-4f11-8c27-ea945057dfb2/volumes"
Oct 30 18:52:05.953112 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:05.953080    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerStarted","Data":"dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2"}
Oct 30 18:52:05.953508 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:05.953140    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerStarted","Data":"ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803"}
Oct 30 18:52:05.953508 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:05.953427    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:52:06.068982 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:06.068935    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podStartSLOduration=3.067334399 podStartE2EDuration="7.068923059s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.00158866s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:52:06.068139799 +0000 UTC m=+815.148810174" watchObservedRunningTime="2026-10-30 18:52:06.068923059 +0000 UTC m=+815.149593433"
Oct 30 18:52:06.910150 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:06.910120    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:52:06.956927 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:06.956897    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:52:06.958093 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:06.958070    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:07.116654 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.116626    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:52:07.511949 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.511916    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"]
Oct 30 18:52:07.512244 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512213    5652 cpu_manager.go:414] "containerMap: removing container" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="storage-initializer"
Oct 30 18:52:07.512244 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512239    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="storage-initializer"
Oct 30 18:52:07.512332 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512268    5652 cpu_manager.go:414] "containerMap: removing container" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container"
Oct 30 18:52:07.512332 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512273    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container"
Oct 30 18:52:07.512332 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512282    5652 cpu_manager.go:414] "containerMap: removing container" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kube-rbac-proxy"
Oct 30 18:52:07.512332 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512287    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kube-rbac-proxy"
Oct 30 18:52:07.512467 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512338    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kserve-container"
Oct 30 18:52:07.512467 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.512345    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="04bc47e8-bed1-4f11-8c27-ea945057dfb2" containerName="kube-rbac-proxy"
Oct 30 18:52:07.515445 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.515428    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.541975 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.541948    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.542096 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.541987    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.542096 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.542009    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.542096 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.542073    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwrjg\" (UniqueName: \"kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.542240 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.542153    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.566396 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.566373    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"kube-root-ca.crt\""
Oct 30 18:52:07.566516 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.566417    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-raw-sklearn-batcher-b337a-kube-rbac-proxy-sar-config\""
Oct 30 18:52:07.611185 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.611138    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"openshift-service-ca.crt\""
Oct 30 18:52:07.611185 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.611176    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-raw-sklearn-batcher-b337a-predictor-serving-cert\""
Oct 30 18:52:07.611375 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.611195    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:52:07.611375 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.611271    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"seaweedfs-s3-creds\""
Oct 30 18:52:07.611375 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.611342    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"default-dockercfg-tx9z6\""
Oct 30 18:52:07.612603 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.612585    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"]
Oct 30 18:52:07.642994 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.642969    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643093 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643004    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643152 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643121    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643205 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643160    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwrjg\" (UniqueName: \"kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643287 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643214    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643440 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643417    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643704 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643687    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.643828 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.643811    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.645691 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.645667    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.702533 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.702511    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwrjg\" (UniqueName: \"kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg\") pod \"isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") " pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.835502 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.835479    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:07.959874 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:07.959837    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:08.249832 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:08.249759    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"]
Oct 30 18:52:08.252803 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:52:08.252772    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9a6b2d_51d1_4486_86d7_ed68e114cf64.slice/crio-010288d940135c1853958e71d2716907ee0435e14016f49da0cef4de6b9b7772 WatchSource:0}: Error finding container 010288d940135c1853958e71d2716907ee0435e14016f49da0cef4de6b9b7772: Status 404 returned error can't find the container with id 010288d940135c1853958e71d2716907ee0435e14016f49da0cef4de6b9b7772
Oct 30 18:52:08.966312 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:08.966271    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerStarted","Data":"a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781"}
Oct 30 18:52:08.966803 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:08.966341    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerStarted","Data":"010288d940135c1853958e71d2716907ee0435e14016f49da0cef4de6b9b7772"}
Oct 30 18:52:10.820623 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:52:10.820546    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:52:12.964973 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:12.964947    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:52:12.965566 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:12.965533    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:12.980913 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:12.980884    5652 generic.go:356] "Generic (PLEG): container finished" podID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerID="a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781" exitCode=0
Oct 30 18:52:12.981016 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:12.980947    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerDied","Data":"a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781"}
Oct 30 18:52:13.086992 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:13.086976    5652 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 18:52:13.986512 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:13.986471    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerStarted","Data":"b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29"}
Oct 30 18:52:13.986852 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:13.986564    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerStarted","Data":"63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231"}
Oct 30 18:52:21.014699 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:21.014651    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerStarted","Data":"5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6"}
Oct 30 18:52:21.015107 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:21.014858    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:21.019671 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:21.019645    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:21.223671 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:21.223609    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podStartSLOduration=3.579495505 podStartE2EDuration="14.223590686s" totalImagesPullingTime="6.911364854s" totalInitContainerRuntime="3.732730327s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:52:21.177165811 +0000 UTC m=+830.257836185" watchObservedRunningTime="2026-10-30 18:52:21.223590686 +0000 UTC m=+830.304261059"
Oct 30 18:52:22.018525 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:22.018493    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:22.018976 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:22.018566    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:52:22.018976 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:22.018768    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:52:22.019285 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:22.019261    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:52:22.966406 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:22.966367    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:23.021842 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:23.021804    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:52:23.022263 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:23.022076    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:52:32.687045 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:32.687010    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:52:32.966387 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:32.966304    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:33.022614 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:33.022583    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:52:33.023068 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:33.023047    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:52:33.654196 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:33.654166    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:52:40.821327 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:52:40.821285    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:52:42.965750 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:42.965708    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:43.021770 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:43.021709    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:52:43.022032 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:43.022006    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:52:52.965831 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:52.965786    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:52:53.022349 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:53.022312    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:52:53.022823 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:52:53.022798    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:53:02.966185 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:02.966148    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:53:03.021911 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:03.021867    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:53:03.022401 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:03.022374    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:53:03.929592 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:03.929556    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:05.096515 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:05.096478    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:10.821042 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:53:10.820998    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:53:12.965740 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:12.965703    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:53:13.022324 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:13.022286    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:53:13.022782 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:13.022753    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:53:15.899362 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:15.899326    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:16.115755 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:16.115714    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:19.033700 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:19.033656    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused"
Oct 30 18:53:23.022161 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:23.022114    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:53:23.022644 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:23.022505    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:53:28.121363 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:28.121329    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:29.040880 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:29.040851    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:53:33.014035 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:33.013996    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:33.022613 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:33.022592    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:53:33.022914 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:33.022895    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:53:39.667033 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:39.667003    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"]
Oct 30 18:53:39.667491 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:39.667220    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container" containerID="cri-o://ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803" gracePeriod=30
Oct 30 18:53:39.667491 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:39.667286    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kube-rbac-proxy" containerID="cri-o://dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2" gracePeriod=30
Oct 30 18:53:39.712397 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:39.712369    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:40.304806 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:40.304772    5652 generic.go:356] "Generic (PLEG): container finished" podID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerID="dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2" exitCode=0
Oct 30 18:53:40.304986 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:40.304844    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerDied","Data":"dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2"}
Oct 30 18:53:40.820392 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:53:40.820360    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:53:42.691096 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:42.691063    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"]
Oct 30 18:53:42.691521 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:42.691362    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" containerID="cri-o://63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231" gracePeriod=30
Oct 30 18:53:42.691521 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:42.691379    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" containerID="cri-o://b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29" gracePeriod=30
Oct 30 18:53:42.691521 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:42.691460    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" containerID="cri-o://5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6" gracePeriod=30
Oct 30 18:53:42.718524 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:42.718499    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:42.960915 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:42.960835    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.18:8643/healthz\": dial tcp 10.134.0.18:8643: connect: connection refused"
Oct 30 18:53:43.022436 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:43.022393    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:53:43.022667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:43.022640    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:53:43.318814 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:43.318785    5652 generic.go:356] "Generic (PLEG): container finished" podID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerID="b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29" exitCode=0
Oct 30 18:53:43.318964 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:43.318857    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerDied","Data":"b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29"}
Oct 30 18:53:44.108270 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.108245    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:53:44.199091 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.199049    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:44.212650 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.212628    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location\") pod \"e17d9b11-f905-4395-b40f-ea5e35f4709f\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") "
Oct 30 18:53:44.212778 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.212765    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k\" (UniqueName: \"kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k\") pod \"e17d9b11-f905-4395-b40f-ea5e35f4709f\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") "
Oct 30 18:53:44.212828 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.212809    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert\") pod \"e17d9b11-f905-4395-b40f-ea5e35f4709f\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") "
Oct 30 18:53:44.212893 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.212876    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls\") pod \"e17d9b11-f905-4395-b40f-ea5e35f4709f\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") "
Oct 30 18:53:44.212933 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.212890    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location" pod "e17d9b11-f905-4395-b40f-ea5e35f4709f" (UID: "e17d9b11-f905-4395-b40f-ea5e35f4709f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:53:44.212933 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.212910    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config\") pod \"e17d9b11-f905-4395-b40f-ea5e35f4709f\" (UID: \"e17d9b11-f905-4395-b40f-ea5e35f4709f\") "
Oct 30 18:53:44.213140 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.213120    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e17d9b11-f905-4395-b40f-ea5e35f4709f-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:53:44.213258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.213182    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert" pod "e17d9b11-f905-4395-b40f-ea5e35f4709f" (UID: "e17d9b11-f905-4395-b40f-ea5e35f4709f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:53:44.213309 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.213291    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config" pod "e17d9b11-f905-4395-b40f-ea5e35f4709f" (UID: "e17d9b11-f905-4395-b40f-ea5e35f4709f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:53:44.214829 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.214804    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k" pod "e17d9b11-f905-4395-b40f-ea5e35f4709f" (UID: "e17d9b11-f905-4395-b40f-ea5e35f4709f"). InnerVolumeSpecName "kube-api-access-k4c6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:53:44.214829 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.214816    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls" pod "e17d9b11-f905-4395-b40f-ea5e35f4709f" (UID: "e17d9b11-f905-4395-b40f-ea5e35f4709f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:53:44.313903 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.313875    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:53:44.313903 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.313901    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e17d9b11-f905-4395-b40f-ea5e35f4709f-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:53:44.314076 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.313912    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:53:44.314076 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.313921    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4c6k\" (UniqueName: \"kubernetes.io/projected/e17d9b11-f905-4395-b40f-ea5e35f4709f-kube-api-access-k4c6k\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:53:44.325147 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.325121    5652 generic.go:356] "Generic (PLEG): container finished" podID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerID="ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803" exitCode=0
Oct 30 18:53:44.325266 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.325179    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"
Oct 30 18:53:44.325266 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.325182    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerDied","Data":"ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803"}
Oct 30 18:53:44.325361 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.325297    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c" event={"ID":"e17d9b11-f905-4395-b40f-ea5e35f4709f","Type":"ContainerDied","Data":"5671b8577f8a6bc04ba9dbb3bf09420e5838c0bde09c73669446ee1dbd42182f"}
Oct 30 18:53:44.325361 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.325323    5652 scope.go:122] "RemoveContainer" containerID="dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2"
Oct 30 18:53:44.333790 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.333772    5652 scope.go:122] "RemoveContainer" containerID="ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803"
Oct 30 18:53:44.340634 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.340614    5652 scope.go:122] "RemoveContainer" containerID="ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2"
Oct 30 18:53:44.347945 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.347928    5652 scope.go:122] "RemoveContainer" containerID="dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2"
Oct 30 18:53:44.348186 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:53:44.348169    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2\": container with ID starting with dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2 not found: ID does not exist" containerID="dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2"
Oct 30 18:53:44.348254 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.348194    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2"} err="failed to get container status \"dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2\": rpc error: code = NotFound desc = could not find container \"dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2\": container with ID starting with dcf70ac81d7d698f03d8becd2ed3a345a843044838f06a7e4d159a1fa1d4aad2 not found: ID does not exist"
Oct 30 18:53:44.348254 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.348212    5652 scope.go:122] "RemoveContainer" containerID="ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803"
Oct 30 18:53:44.348529 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:53:44.348510    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803\": container with ID starting with ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803 not found: ID does not exist" containerID="ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803"
Oct 30 18:53:44.348604 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.348537    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803"} err="failed to get container status \"ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803\": rpc error: code = NotFound desc = could not find container \"ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803\": container with ID starting with ebc80e834b90ba9bf1e5ccb4fd9e0d4b825ae18c731fb2ae2d8a02463a913803 not found: ID does not exist"
Oct 30 18:53:44.348604 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.348563    5652 scope.go:122] "RemoveContainer" containerID="ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2"
Oct 30 18:53:44.348807 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:53:44.348791    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2\": container with ID starting with ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2 not found: ID does not exist" containerID="ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2"
Oct 30 18:53:44.348864 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.348817    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2"} err="failed to get container status \"ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2\": rpc error: code = NotFound desc = could not find container \"ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2\": container with ID starting with ad1bf4c5b575188b85029c91825e8d3c7f649fd62352c132d4c83b26fbacc8c2 not found: ID does not exist"
Oct 30 18:53:44.481782 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.481697    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"]
Oct 30 18:53:44.489757 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:44.489730    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-rollback-predictor-554c7cc56d-4v44c"]
Oct 30 18:53:45.038981 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:45.038937    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" path="/var/lib/kubelet/pods/e17d9b11-f905-4395-b40f-ea5e35f4709f/volumes"
Oct 30 18:53:46.015098 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:46.015065    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
Oct 30 18:53:47.346720 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:47.346633    5652 generic.go:356] "Generic (PLEG): container finished" podID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerID="63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231" exitCode=0
Oct 30 18:53:47.346720 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:47.346689    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerDied","Data":"63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231"}
Oct 30 18:53:47.945655 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:47.945615    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:53:51.015136 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:51.015099    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
Oct 30 18:53:53.022273 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:53.022204    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:53:53.022716 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:53.022580    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:53:56.015840 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:56.015793    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
Oct 30 18:53:56.016277 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:53:56.015940    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:54:01.016132 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:01.016087    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
Oct 30 18:54:03.022627 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:03.022580    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
Oct 30 18:54:03.023069 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:03.022750    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:54:03.023069 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:03.022920    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 18:54:03.023069 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:03.023041    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:54:06.015387 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:06.015350    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
Oct 30 18:54:06.579433 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:06.579394    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:07.612387 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:07.612348    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:10.820565 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:54:10.820525    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:54:11.015458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:11.015426    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
Oct 30 18:54:12.839950 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.839926    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:54:12.918627 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.918603    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg\" (UniqueName: \"kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg\") pod \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") "
Oct 30 18:54:12.918737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.918637    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert\") pod \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") "
Oct 30 18:54:12.918737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.918667    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config\") pod \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") "
Oct 30 18:54:12.918737 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.918693    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls\") pod \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") "
Oct 30 18:54:12.918895 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.918737    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location\") pod \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\" (UID: \"7d9a6b2d-51d1-4486-86d7-ed68e114cf64\") "
Oct 30 18:54:12.919100 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.918986    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config" pod "7d9a6b2d-51d1-4486-86d7-ed68e114cf64" (UID: "7d9a6b2d-51d1-4486-86d7-ed68e114cf64"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:54:12.919100 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.919087    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location" pod "7d9a6b2d-51d1-4486-86d7-ed68e114cf64" (UID: "7d9a6b2d-51d1-4486-86d7-ed68e114cf64"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:54:12.919222 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.919076    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert" pod "7d9a6b2d-51d1-4486-86d7-ed68e114cf64" (UID: "7d9a6b2d-51d1-4486-86d7-ed68e114cf64"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:54:12.920786 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.920764    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls" pod "7d9a6b2d-51d1-4486-86d7-ed68e114cf64" (UID: "7d9a6b2d-51d1-4486-86d7-ed68e114cf64"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:54:12.920885 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:12.920832    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg" pod "7d9a6b2d-51d1-4486-86d7-ed68e114cf64" (UID: "7d9a6b2d-51d1-4486-86d7-ed68e114cf64"). InnerVolumeSpecName "kube-api-access-dwrjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:54:13.019458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.019405    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:13.019458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.019426    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwrjg\" (UniqueName: \"kubernetes.io/projected/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-api-access-dwrjg\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:13.019458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.019436    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:13.019458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.019445    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:13.019458 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.019456    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d9a6b2d-51d1-4486-86d7-ed68e114cf64-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:13.446029 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.445994    5652 generic.go:356] "Generic (PLEG): container finished" podID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerID="5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6" exitCode=0
Oct 30 18:54:13.446199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.446055    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"
Oct 30 18:54:13.446199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.446082    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerDied","Data":"5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6"}
Oct 30 18:54:13.446199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.446150    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f" event={"ID":"7d9a6b2d-51d1-4486-86d7-ed68e114cf64","Type":"ContainerDied","Data":"010288d940135c1853958e71d2716907ee0435e14016f49da0cef4de6b9b7772"}
Oct 30 18:54:13.446199 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.446184    5652 scope.go:122] "RemoveContainer" containerID="5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6"
Oct 30 18:54:13.454134 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.454119    5652 scope.go:122] "RemoveContainer" containerID="b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29"
Oct 30 18:54:13.460948 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.460931    5652 scope.go:122] "RemoveContainer" containerID="63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231"
Oct 30 18:54:13.467644 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.467628    5652 scope.go:122] "RemoveContainer" containerID="a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781"
Oct 30 18:54:13.474525 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.474507    5652 scope.go:122] "RemoveContainer" containerID="5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6"
Oct 30 18:54:13.474788 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:54:13.474763    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6\": container with ID starting with 5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6 not found: ID does not exist" containerID="5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6"
Oct 30 18:54:13.474852 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.474799    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6"} err="failed to get container status \"5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6\": rpc error: code = NotFound desc = could not find container \"5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6\": container with ID starting with 5cd432baa8c0e0b264bdeb0e4cc0c1e2df2005f55b51c9bdde183f8efd798ee6 not found: ID does not exist"
Oct 30 18:54:13.474852 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.474817    5652 scope.go:122] "RemoveContainer" containerID="b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29"
Oct 30 18:54:13.475081 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:54:13.475063    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29\": container with ID starting with b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29 not found: ID does not exist" containerID="b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29"
Oct 30 18:54:13.475117 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.475087    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29"} err="failed to get container status \"b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29\": rpc error: code = NotFound desc = could not find container \"b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29\": container with ID starting with b6ec962359eda708bb0283f8a0b03265b4d05fc0e24c91add53a4e49ba5b0c29 not found: ID does not exist"
Oct 30 18:54:13.475117 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.475104    5652 scope.go:122] "RemoveContainer" containerID="63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231"
Oct 30 18:54:13.475342 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:54:13.475327    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231\": container with ID starting with 63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231 not found: ID does not exist" containerID="63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231"
Oct 30 18:54:13.475392 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.475346    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231"} err="failed to get container status \"63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231\": rpc error: code = NotFound desc = could not find container \"63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231\": container with ID starting with 63c6edb1ec20b28610daea8bb33ce5939a950f3efe4e9d7af6ae47981bd82231 not found: ID does not exist"
Oct 30 18:54:13.475392 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.475358    5652 scope.go:122] "RemoveContainer" containerID="a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781"
Oct 30 18:54:13.475567 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:54:13.475551    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781\": container with ID starting with a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781 not found: ID does not exist" containerID="a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781"
Oct 30 18:54:13.475605 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.475573    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781"} err="failed to get container status \"a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781\": rpc error: code = NotFound desc = could not find container \"a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781\": container with ID starting with a47d560996aaf01169139ab1f7c646d28e633bc64b765ecda69adfd60f2c7781 not found: ID does not exist"
Oct 30 18:54:13.602602 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.602577    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"]
Oct 30 18:54:13.648672 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:13.648647    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-raw-sklearn-batcher-b337a-predictor-777c8b74b7-8lq9f"]
Oct 30 18:54:15.037918 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:15.037882    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" path="/var/lib/kubelet/pods/7d9a6b2d-51d1-4486-86d7-ed68e114cf64/volumes"
Oct 30 18:54:15.800453 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:15.800418    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:16.103145 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.103109    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:16.491154 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491080    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"]
Oct 30 18:54:16.491387 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491374    5652 cpu_manager.go:414] "containerMap: removing container" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491388    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491402    5652 cpu_manager.go:414] "containerMap: removing container" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="storage-initializer"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491408    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="storage-initializer"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491416    5652 cpu_manager.go:414] "containerMap: removing container" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491420    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491427    5652 cpu_manager.go:414] "containerMap: removing container" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491432    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container"
Oct 30 18:54:16.491443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491444    5652 cpu_manager.go:414] "containerMap: removing container" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491448    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491459    5652 cpu_manager.go:414] "containerMap: removing container" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="storage-initializer"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491463    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="storage-initializer"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491475    5652 cpu_manager.go:414] "containerMap: removing container" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kube-rbac-proxy"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491479    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kube-rbac-proxy"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491523    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="agent"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491530    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kube-rbac-proxy"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491536    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kserve-container"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491542    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d9a6b2d-51d1-4486-86d7-ed68e114cf64" containerName="kserve-container"
Oct 30 18:54:16.491675 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.491550    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="e17d9b11-f905-4395-b40f-ea5e35f4709f" containerName="kube-rbac-proxy"
Oct 30 18:54:16.494403 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.494383    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.545431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.545409    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-sklearn-graph-raw-bdcff-kube-rbac-proxy-sar-config\""
Oct 30 18:54:16.545664 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.545642    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pndlv\" (UniqueName: \"kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.545747 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.545679    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.545848 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.545758    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.545889 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.545859    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.545927 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.545890    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.590015 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.589995    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"kube-root-ca.crt\""
Oct 30 18:54:16.590258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.590239    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"seaweedfs-s3-creds\""
Oct 30 18:54:16.590258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.590242    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:54:16.590438 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.590257    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"openshift-service-ca.crt\""
Oct 30 18:54:16.590438 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.590295    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"default-dockercfg-tx9z6\""
Oct 30 18:54:16.590438 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.590387    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-sklearn-graph-raw-bdcff-predictor-serving-cert\""
Oct 30 18:54:16.592205 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.592186    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"]
Oct 30 18:54:16.646752 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.646732    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.646855 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.646761    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.646855 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.646798    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pndlv\" (UniqueName: \"kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.646855 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.646816    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.647008 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.646855    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.647204 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.647183    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.647454 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.647430    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.647501 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.647461    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.649139 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.649122    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.705807 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.705785    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pndlv\" (UniqueName: \"kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv\") pod \"isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:16.810465 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:16.810445    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:17.059728 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:17.059698    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:17.230256 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:17.230151    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"]
Oct 30 18:54:17.234047 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:54:17.234015    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649bf29a_0a05_45bd_9cab_9754b14e8620.slice/crio-655d47113c101fc9f434b5ab50985ceb8bad7c9c6a3c71b10c8cea5494e17609 WatchSource:0}: Error finding container 655d47113c101fc9f434b5ab50985ceb8bad7c9c6a3c71b10c8cea5494e17609: Status 404 returned error can't find the container with id 655d47113c101fc9f434b5ab50985ceb8bad7c9c6a3c71b10c8cea5494e17609
Oct 30 18:54:17.271508 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:17.271481    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:17.462782 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:17.462747    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerStarted","Data":"6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330"}
Oct 30 18:54:17.462970 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:17.462817    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerStarted","Data":"655d47113c101fc9f434b5ab50985ceb8bad7c9c6a3c71b10c8cea5494e17609"}
Oct 30 18:54:21.479016 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:21.478927    5652 generic.go:356] "Generic (PLEG): container finished" podID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerID="6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330" exitCode=0
Oct 30 18:54:21.479016 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:21.478974    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerDied","Data":"6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330"}
Oct 30 18:54:22.484436 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:22.484399    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerStarted","Data":"6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a"}
Oct 30 18:54:22.484808 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:22.484466    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerStarted","Data":"cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b"}
Oct 30 18:54:22.484808 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:22.484670    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:22.600183 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:22.600132    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podStartSLOduration=2.712380962 podStartE2EDuration="6.600115378s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.887734416s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:54:22.599641483 +0000 UTC m=+951.680311858" watchObservedRunningTime="2026-10-30 18:54:22.600115378 +0000 UTC m=+951.680785755"
Oct 30 18:54:23.487863 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:23.487825    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:23.488954 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:23.488924    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:54:24.490727 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:24.490680    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:54:29.495061 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:29.495036    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:54:29.495520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:29.495494    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:54:33.456923 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:33.456870    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:54:39.495806 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:39.495769    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:54:40.820418 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:54:40.820380    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:54:49.496158 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:49.496122    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:54:59.496163 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:54:59.496116    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:55:02.992481 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:02.992445    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:55:03.993330 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:03.993295    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:55:09.495858 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:09.495823    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:55:10.820154 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:55:10.820069    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:55:19.495569 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:19.495532    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:55:29.495459 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:29.495420    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:55:33.718959 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:33.718922    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:55:39.496399 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:39.496358    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:55:40.820246 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:55:40.820193    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:55:56.152987 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.152951    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:55:56.180096 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.180070    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"]
Oct 30 18:55:56.184927 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.184910    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.238409 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.238389    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"]
Oct 30 18:55:56.283521 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.283486    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"model-chainer-raw-bdcff-serving-cert\""
Oct 30 18:55:56.283665 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.283544    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"model-chainer-raw-bdcff-kube-rbac-proxy-sar-config\""
Oct 30 18:55:56.288358 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.288338    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle\") pod \"model-chainer-raw-bdcff-b79b8bbb6-lrhdv\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.288431 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.288375    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls\") pod \"model-chainer-raw-bdcff-b79b8bbb6-lrhdv\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.389485 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.389453    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls\") pod \"model-chainer-raw-bdcff-b79b8bbb6-lrhdv\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.389626 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.389557    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle\") pod \"model-chainer-raw-bdcff-b79b8bbb6-lrhdv\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.390150 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.390128    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle\") pod \"model-chainer-raw-bdcff-b79b8bbb6-lrhdv\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.391837 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.391817    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls\") pod \"model-chainer-raw-bdcff-b79b8bbb6-lrhdv\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.495330 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.495246    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:55:56.497194 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.497174    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:55:56.858561 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:56.858535    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"]
Oct 30 18:55:56.861733 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:55:56.861703    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf504ed08_afdf_46e2_8628_b520e52e92c1.slice/crio-011f707665fbddd2af23177fd7e314189082aa47b6623424906e342fc1bd176b WatchSource:0}: Error finding container 011f707665fbddd2af23177fd7e314189082aa47b6623424906e342fc1bd176b: Status 404 returned error can't find the container with id 011f707665fbddd2af23177fd7e314189082aa47b6623424906e342fc1bd176b
Oct 30 18:55:57.826923 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:55:57.826888    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" event={"ID":"f504ed08-afdf-46e2-8628-b520e52e92c1","Type":"ContainerStarted","Data":"011f707665fbddd2af23177fd7e314189082aa47b6623424906e342fc1bd176b"}
Oct 30 18:56:04.852421 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:04.852387    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" event={"ID":"f504ed08-afdf-46e2-8628-b520e52e92c1","Type":"ContainerStarted","Data":"52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae"}
Oct 30 18:56:04.852800 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:04.852497    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:56:04.971457 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:04.971409    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podStartSLOduration=2.007728057 podStartE2EDuration="8.971394949s" totalImagesPullingTime="6.963666892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:56:04.971062638 +0000 UTC m=+1054.051733014" watchObservedRunningTime="2026-10-30 18:56:04.971394949 +0000 UTC m=+1054.052065323"
Oct 30 18:56:07.419241 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.419188    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"]
Oct 30 18:56:07.419634 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.419545    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" containerID="cri-o://cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b" gracePeriod=30
Oct 30 18:56:07.419634 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.419570    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kube-rbac-proxy" containerID="cri-o://6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a" gracePeriod=30
Oct 30 18:56:07.492746 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.492723    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:07.808634 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.808603    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:07.865238 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.865197    5652 generic.go:356] "Generic (PLEG): container finished" podID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerID="6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a" exitCode=0
Oct 30 18:56:07.865374 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:07.865259    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerDied","Data":"6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a"}
Oct 30 18:56:09.491575 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:09.491537    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.20:8643/healthz\": dial tcp 10.134.0.20:8643: connect: connection refused"
Oct 30 18:56:09.496272 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:09.496215    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
Oct 30 18:56:10.820900 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:56:10.820861    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:56:10.862815 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:10.862793    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 18:56:11.858985 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.858958    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:56:11.880328 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.880304    5652 generic.go:356] "Generic (PLEG): container finished" podID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerID="cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b" exitCode=0
Oct 30 18:56:11.880451 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.880367    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"
Oct 30 18:56:11.880451 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.880382    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerDied","Data":"cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b"}
Oct 30 18:56:11.880451 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.880440    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t" event={"ID":"649bf29a-0a05-45bd-9cab-9754b14e8620","Type":"ContainerDied","Data":"655d47113c101fc9f434b5ab50985ceb8bad7c9c6a3c71b10c8cea5494e17609"}
Oct 30 18:56:11.880603 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.880468    5652 scope.go:122] "RemoveContainer" containerID="6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a"
Oct 30 18:56:11.887691 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.887677    5652 scope.go:122] "RemoveContainer" containerID="cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b"
Oct 30 18:56:11.894202 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.894177    5652 scope.go:122] "RemoveContainer" containerID="6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330"
Oct 30 18:56:11.900936 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.900919    5652 scope.go:122] "RemoveContainer" containerID="6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a"
Oct 30 18:56:11.901190 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:56:11.901171    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a\": container with ID starting with 6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a not found: ID does not exist" containerID="6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a"
Oct 30 18:56:11.901243 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.901200    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a"} err="failed to get container status \"6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a\": rpc error: code = NotFound desc = could not find container \"6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a\": container with ID starting with 6a41cd9a13dfb4881f307c663ecc2ad53ee48b5cb540a3cae54f04860bd9577a not found: ID does not exist"
Oct 30 18:56:11.901243 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.901217    5652 scope.go:122] "RemoveContainer" containerID="cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b"
Oct 30 18:56:11.901477 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:56:11.901463    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b\": container with ID starting with cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b not found: ID does not exist" containerID="cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b"
Oct 30 18:56:11.901520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.901482    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b"} err="failed to get container status \"cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b\": rpc error: code = NotFound desc = could not find container \"cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b\": container with ID starting with cbdee6c48c384ef5c77c8fa4815d2936bdbe84d3f15a146c761a87542db9d73b not found: ID does not exist"
Oct 30 18:56:11.901520 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.901496    5652 scope.go:122] "RemoveContainer" containerID="6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330"
Oct 30 18:56:11.901685 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:56:11.901671    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330\": container with ID starting with 6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330 not found: ID does not exist" containerID="6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330"
Oct 30 18:56:11.901725 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:11.901686    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330"} err="failed to get container status \"6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330\": rpc error: code = NotFound desc = could not find container \"6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330\": container with ID starting with 6cc0bf16e56bb86d84820d8d17456b2bac7e726418994bbd4cc3215fbd8c3330 not found: ID does not exist"
Oct 30 18:56:12.033604 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033550    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location\") pod \"649bf29a-0a05-45bd-9cab-9754b14e8620\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") "
Oct 30 18:56:12.033725 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033610    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert\") pod \"649bf29a-0a05-45bd-9cab-9754b14e8620\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") "
Oct 30 18:56:12.033725 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033651    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls\" (UniqueName: \"kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls\") pod \"649bf29a-0a05-45bd-9cab-9754b14e8620\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") "
Oct 30 18:56:12.033725 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033709    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv\" (UniqueName: \"kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv\") pod \"649bf29a-0a05-45bd-9cab-9754b14e8620\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") "
Oct 30 18:56:12.033883 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033782    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config\") pod \"649bf29a-0a05-45bd-9cab-9754b14e8620\" (UID: \"649bf29a-0a05-45bd-9cab-9754b14e8620\") "
Oct 30 18:56:12.033883 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033868    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location" pod "649bf29a-0a05-45bd-9cab-9754b14e8620" (UID: "649bf29a-0a05-45bd-9cab-9754b14e8620"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:56:12.034001 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033973    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert" pod "649bf29a-0a05-45bd-9cab-9754b14e8620" (UID: "649bf29a-0a05-45bd-9cab-9754b14e8620"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:56:12.034001 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.033991    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/649bf29a-0a05-45bd-9cab-9754b14e8620-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:12.034195 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.034174    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config" pod "649bf29a-0a05-45bd-9cab-9754b14e8620" (UID: "649bf29a-0a05-45bd-9cab-9754b14e8620"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:56:12.035791 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.035767    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv" pod "649bf29a-0a05-45bd-9cab-9754b14e8620" (UID: "649bf29a-0a05-45bd-9cab-9754b14e8620"). InnerVolumeSpecName "kube-api-access-pndlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:56:12.035791 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.035777    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls" pod "649bf29a-0a05-45bd-9cab-9754b14e8620" (UID: "649bf29a-0a05-45bd-9cab-9754b14e8620"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:56:12.134704 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.134684    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pndlv\" (UniqueName: \"kubernetes.io/projected/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-api-access-pndlv\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:12.134797 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.134707    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:12.134797 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.134718    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/649bf29a-0a05-45bd-9cab-9754b14e8620-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:12.134797 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.134726    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/649bf29a-0a05-45bd-9cab-9754b14e8620-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:12.298565 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.298487    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"]
Oct 30 18:56:12.306740 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:12.306710    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-bdcff-predictor-5fb96bb54c-wvc9t"]
Oct 30 18:56:13.037489 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:13.037456    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" path="/var/lib/kubelet/pods/649bf29a-0a05-45bd-9cab-9754b14e8620/volumes"
Oct 30 18:56:15.604473 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:15.604442    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:15.797068 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:15.797038    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:16.285846 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.285812    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"]
Oct 30 18:56:16.286128 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286116    5652 cpu_manager.go:414] "containerMap: removing container" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container"
Oct 30 18:56:16.286168 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286130    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container"
Oct 30 18:56:16.286168 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286152    5652 cpu_manager.go:414] "containerMap: removing container" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kube-rbac-proxy"
Oct 30 18:56:16.286168 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286157    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kube-rbac-proxy"
Oct 30 18:56:16.286168 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286168    5652 cpu_manager.go:414] "containerMap: removing container" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="storage-initializer"
Oct 30 18:56:16.286351 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286173    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="storage-initializer"
Oct 30 18:56:16.286351 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286236    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kserve-container"
Oct 30 18:56:16.286351 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.286247    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="649bf29a-0a05-45bd-9cab-9754b14e8620" containerName="kube-rbac-proxy"
Oct 30 18:56:16.289139 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.289120    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.340148 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.340126    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"seaweedfs-s3-creds\""
Oct 30 18:56:16.340274 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.340151    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-sklearn-graph-raw-hpa-6d75d-predictor-serving-cert\""
Oct 30 18:56:16.385162 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.385136    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-sklearn-graph-raw-hpa-6d75d-kube-rbac-proxy-sar-config\""
Oct 30 18:56:16.385324 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.385158    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:56:16.385324 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.385165    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"kube-root-ca.crt\""
Oct 30 18:56:16.386196 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.386168    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"]
Oct 30 18:56:16.468554 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.468525    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.468657 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.468587    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.468719 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.468701    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxctq\" (UniqueName: \"kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.468756 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.468729    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.468809 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.468796    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.569660 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.569637    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.569763 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.569677    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.569763 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.569699    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxctq\" (UniqueName: \"kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.569870 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.569828    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.569932 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.569882    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.570092 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.570069    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.570423 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.570403    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.570506 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.570457    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.572026 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.572004    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.629183 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.629161    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxctq\" (UniqueName: \"kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq\") pod \"isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:16.848171 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.848104    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:16.905339 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:16.905315    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:17.148651 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:17.148574    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:17.321143 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:17.321115    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"]
Oct 30 18:56:17.324478 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:56:17.324438    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e148209_ed28_424d_a759_4c0f041e8073.slice/crio-172c9f8b0f74828e0cce52a40d7adb83f481ae5c84e14c9568bac06aaa988efe WatchSource:0}: Error finding container 172c9f8b0f74828e0cce52a40d7adb83f481ae5c84e14c9568bac06aaa988efe: Status 404 returned error can't find the container with id 172c9f8b0f74828e0cce52a40d7adb83f481ae5c84e14c9568bac06aaa988efe
Oct 30 18:56:17.908597 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:17.908559    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerStarted","Data":"2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741"}
Oct 30 18:56:17.908947 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:17.908633    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerStarted","Data":"172c9f8b0f74828e0cce52a40d7adb83f481ae5c84e14c9568bac06aaa988efe"}
Oct 30 18:56:21.924029 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:21.923997    5652 generic.go:356] "Generic (PLEG): container finished" podID="1e148209-ed28-424d-a759-4c0f041e8073" containerID="2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741" exitCode=0
Oct 30 18:56:21.924489 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:21.924068    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerDied","Data":"2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741"}
Oct 30 18:56:22.929645 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:22.929613    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerStarted","Data":"eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf"}
Oct 30 18:56:22.930017 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:22.929672    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerStarted","Data":"5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6"}
Oct 30 18:56:22.930017 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:22.929864    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:23.045513 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:23.045448    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podStartSLOduration=3.089262074 podStartE2EDuration="7.045432697s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.956170623s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:56:23.044853588 +0000 UTC m=+1072.125523962" watchObservedRunningTime="2026-10-30 18:56:23.045432697 +0000 UTC m=+1072.126103072"
Oct 30 18:56:23.933762 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:23.933727    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:23.934956 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:23.934928    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:56:24.936774 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:24.936735    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:56:29.941851 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:29.941819    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:56:29.942342 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:29.942306    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:56:34.024420 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:34.024351    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:56:39.942843 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:39.942800    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:56:40.820543 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:56:40.820467    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:56:49.942468 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:49.942425    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:56:59.942526 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:56:59.942484    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:57:00.264517 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:00.264441    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:57:00.444849 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:00.444818    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:57:09.942537 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:09.942490    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:57:10.819852 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:57:10.819810    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:57:19.943093 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:19.943053    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:57:29.942499 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:29.942457    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:57:34.346077 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:34.346043    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:57:39.943387 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:39.943355    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:57:40.820687 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:57:40.820651    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:57:43.593049 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:43.593014    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:57:46.341829 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:46.341784    5652 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" podUID="280f4af3efbb64161ef5d0dff38bf2c2" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Oct 30 18:57:55.867195 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:55.867143    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:57:55.953071 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:55.953040    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"]
Oct 30 18:57:55.956170 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:55.956154    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.028413 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.028384    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls\") pod \"model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.028526 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.028424    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.045748 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.045726    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"model-chainer-raw-hpa-6d75d-kube-rbac-proxy-sar-config\""
Oct 30 18:57:56.051343 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.051322    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"model-chainer-raw-hpa-6d75d-serving-cert\""
Oct 30 18:57:56.052029 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.052011    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"]
Oct 30 18:57:56.115003 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.114980    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:57:56.129198 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.129148    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls\") pod \"model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.129198 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.129180    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.129762 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.129744    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.131668 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.131647    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls\") pod \"model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") " pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.267955 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.267929    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:56.630816 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:56.630787    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"]
Oct 30 18:57:56.634250 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:57:56.634205    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0932751_3f89_4dc1_87de_1345dfcead80.slice/crio-8f10ca37ca63d6246cc62e93448cc98a046615612658023b6f50bb814884ba17 WatchSource:0}: Error finding container 8f10ca37ca63d6246cc62e93448cc98a046615612658023b6f50bb814884ba17: Status 404 returned error can't find the container with id 8f10ca37ca63d6246cc62e93448cc98a046615612658023b6f50bb814884ba17
Oct 30 18:57:57.259776 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:57.259740    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" event={"ID":"e0932751-3f89-4dc1-87de-1345dfcead80","Type":"ContainerStarted","Data":"06df216bc249130fa2e7b1e5371117efa09bd6a3c2539df3a775e9c92350b749"}
Oct 30 18:57:57.260284 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:57.259800    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" event={"ID":"e0932751-3f89-4dc1-87de-1345dfcead80","Type":"ContainerStarted","Data":"8f10ca37ca63d6246cc62e93448cc98a046615612658023b6f50bb814884ba17"}
Oct 30 18:57:57.260284 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:57.259858    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:57:57.371102 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:57:57.371033    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podStartSLOduration=2.371018313 podStartE2EDuration="2.371018313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:57:57.3699635 +0000 UTC m=+1166.450633873" watchObservedRunningTime="2026-10-30 18:57:57.371018313 +0000 UTC m=+1166.451688687"
Oct 30 18:58:03.268720 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:03.268692    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 18:58:03.281407 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:03.281381    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:03.477483 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:03.477427    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:03.794245 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:03.794194    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:04.121959 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.121928    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:04.226757 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.226721    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"]
Oct 30 18:58:04.230292 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.230270    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.293020 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.292993    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.293379 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.293040    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.293379 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.293059    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.293379 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.293176    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.293379 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.293208    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhnn5\" (UniqueName: \"kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.358686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358570    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Oct 30 18:58:04.358686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358586    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"default-dockercfg-zc4kv\""
Oct 30 18:58:04.358686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358570    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"kube-root-ca.crt\""
Oct 30 18:58:04.358686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358596    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:58:04.358686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358628    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"openshift-service-ca.crt\""
Oct 30 18:58:04.358686 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358639    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"seaweedfs-s3-creds\""
Oct 30 18:58:04.358949 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.358700    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-stop-predictor-serving-cert\""
Oct 30 18:58:04.360054 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.360035    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"]
Oct 30 18:58:04.393615 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.393561    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.393615 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.393586    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.393777 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.393616    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.393777 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.393736    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhnn5\" (UniqueName: \"kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.393881 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.393798    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.394076 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.394044    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.394398 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.394373    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.394455 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.394444    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.395968 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.395948    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.453259 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.453239    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhnn5\" (UniqueName: \"kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5\") pod \"isvc-canary-stop-predictor-594688d7b8-b6gfj\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") " pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.546759 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.546736    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:04.958903 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:04.958871    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"]
Oct 30 18:58:04.962185 ip-10-0-133-244 kubenswrapper[5652]: W1030 18:58:04.962152    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9617177f_128b_4018_ad60_cf8aba71f15d.slice/crio-8eedbcefeaf2b2fe4d1d770bab12e558a1d0d7bcbd6baf514c18a05342490a93 WatchSource:0}: Error finding container 8eedbcefeaf2b2fe4d1d770bab12e558a1d0d7bcbd6baf514c18a05342490a93: Status 404 returned error can't find the container with id 8eedbcefeaf2b2fe4d1d770bab12e558a1d0d7bcbd6baf514c18a05342490a93
Oct 30 18:58:05.289667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:05.289586    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerStarted","Data":"e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024"}
Oct 30 18:58:05.289667 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:05.289654    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerStarted","Data":"8eedbcefeaf2b2fe4d1d770bab12e558a1d0d7bcbd6baf514c18a05342490a93"}
Oct 30 18:58:08.304533 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:08.304506    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"]
Oct 30 18:58:08.304950 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:08.304722    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" containerID="cri-o://5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6" gracePeriod=30
Oct 30 18:58:08.304950 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:08.304769    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kube-rbac-proxy" containerID="cri-o://eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf" gracePeriod=30
Oct 30 18:58:08.348103 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:08.348066    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:08.661535 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:08.661458    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:09.306761 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:09.306727    5652 generic.go:356] "Generic (PLEG): container finished" podID="1e148209-ed28-424d-a759-4c0f041e8073" containerID="eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf" exitCode=0
Oct 30 18:58:09.307168 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:09.306805    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerDied","Data":"eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf"}
Oct 30 18:58:09.308219 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:09.308198    5652 generic.go:356] "Generic (PLEG): container finished" podID="9617177f-128b-4018-ad60-cf8aba71f15d" containerID="e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024" exitCode=0
Oct 30 18:58:09.308325 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:09.308261    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerDied","Data":"e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024"}
Oct 30 18:58:09.937959 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:09.937915    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.22:8643/healthz\": dial tcp 10.134.0.22:8643: connect: connection refused"
Oct 30 18:58:09.942272 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:09.942217    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 18:58:10.314311 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:10.314273    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerStarted","Data":"4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831"}
Oct 30 18:58:10.314676 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:10.314335    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerStarted","Data":"bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb"}
Oct 30 18:58:10.314676 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:10.314528    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:10.441591 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:10.441546    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podStartSLOduration=2.5935199669999998 podStartE2EDuration="6.441533639s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.848013672s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:58:10.440641629 +0000 UTC m=+1179.521312007" watchObservedRunningTime="2026-10-30 18:58:10.441533639 +0000 UTC m=+1179.522204010"
Oct 30 18:58:10.820640 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:58:10.820597    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:58:11.317925 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:11.317885    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:11.318967 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:11.318942    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:58:12.321297 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.321255    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:58:12.846990 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.846969    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:58:12.964630 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.964564    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls\") pod \"1e148209-ed28-424d-a759-4c0f041e8073\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") "
Oct 30 18:58:12.964630 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.964608    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert\") pod \"1e148209-ed28-424d-a759-4c0f041e8073\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") "
Oct 30 18:58:12.964792 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.964636    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location\") pod \"1e148209-ed28-424d-a759-4c0f041e8073\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") "
Oct 30 18:58:12.964792 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.964682    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config\") pod \"1e148209-ed28-424d-a759-4c0f041e8073\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") "
Oct 30 18:58:12.964792 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.964719    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq\" (UniqueName: \"kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq\") pod \"1e148209-ed28-424d-a759-4c0f041e8073\" (UID: \"1e148209-ed28-424d-a759-4c0f041e8073\") "
Oct 30 18:58:12.965049 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.965013    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location" pod "1e148209-ed28-424d-a759-4c0f041e8073" (UID: "1e148209-ed28-424d-a759-4c0f041e8073"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:58:12.965150 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.965024    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert" pod "1e148209-ed28-424d-a759-4c0f041e8073" (UID: "1e148209-ed28-424d-a759-4c0f041e8073"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:58:12.965150 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.965059    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config" pod "1e148209-ed28-424d-a759-4c0f041e8073" (UID: "1e148209-ed28-424d-a759-4c0f041e8073"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:58:12.966714 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.966686    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq" pod "1e148209-ed28-424d-a759-4c0f041e8073" (UID: "1e148209-ed28-424d-a759-4c0f041e8073"). InnerVolumeSpecName "kube-api-access-wxctq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:58:12.966793 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:12.966745    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls" pod "1e148209-ed28-424d-a759-4c0f041e8073" (UID: "1e148209-ed28-424d-a759-4c0f041e8073"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:58:13.065980 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.065956    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e148209-ed28-424d-a759-4c0f041e8073-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:58:13.065980 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.065977    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:58:13.066114 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.065987    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e148209-ed28-424d-a759-4c0f041e8073-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:58:13.066114 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.065996    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e148209-ed28-424d-a759-4c0f041e8073-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:58:13.066114 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.066006    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxctq\" (UniqueName: \"kubernetes.io/projected/1e148209-ed28-424d-a759-4c0f041e8073-kube-api-access-wxctq\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:58:13.326750 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.326718    5652 generic.go:356] "Generic (PLEG): container finished" podID="1e148209-ed28-424d-a759-4c0f041e8073" containerID="5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6" exitCode=0
Oct 30 18:58:13.327241 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.326763    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerDied","Data":"5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6"}
Oct 30 18:58:13.327241 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.326800    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"
Oct 30 18:58:13.327241 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.326834    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4" event={"ID":"1e148209-ed28-424d-a759-4c0f041e8073","Type":"ContainerDied","Data":"172c9f8b0f74828e0cce52a40d7adb83f481ae5c84e14c9568bac06aaa988efe"}
Oct 30 18:58:13.327241 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.326862    5652 scope.go:122] "RemoveContainer" containerID="eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf"
Oct 30 18:58:13.335038 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.335019    5652 scope.go:122] "RemoveContainer" containerID="5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6"
Oct 30 18:58:13.342176 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.342153    5652 scope.go:122] "RemoveContainer" containerID="2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741"
Oct 30 18:58:13.349023 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.349005    5652 scope.go:122] "RemoveContainer" containerID="eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf"
Oct 30 18:58:13.349307 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:58:13.349287    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf\": container with ID starting with eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf not found: ID does not exist" containerID="eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf"
Oct 30 18:58:13.349361 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.349314    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf"} err="failed to get container status \"eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf\": rpc error: code = NotFound desc = could not find container \"eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf\": container with ID starting with eeab8ba87ac9dfd074b9d634bab110b567dfedca04363bed8ac8a2366be6e7bf not found: ID does not exist"
Oct 30 18:58:13.349361 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.349335    5652 scope.go:122] "RemoveContainer" containerID="5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6"
Oct 30 18:58:13.349601 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:58:13.349574    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6\": container with ID starting with 5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6 not found: ID does not exist" containerID="5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6"
Oct 30 18:58:13.349679 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.349607    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6"} err="failed to get container status \"5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6\": rpc error: code = NotFound desc = could not find container \"5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6\": container with ID starting with 5640ab13860f03505d1dbef4bb44cafe80885f66b94f1688c90a229f0411e5e6 not found: ID does not exist"
Oct 30 18:58:13.349679 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.349623    5652 scope.go:122] "RemoveContainer" containerID="2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741"
Oct 30 18:58:13.349867 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:58:13.349848    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741\": container with ID starting with 2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741 not found: ID does not exist" containerID="2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741"
Oct 30 18:58:13.349919 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.349872    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741"} err="failed to get container status \"2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741\": rpc error: code = NotFound desc = could not find container \"2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741\": container with ID starting with 2e3318bf25af7f1353c3589438161225752ac9ffe41ff29f4e3ba287f07e9741 not found: ID does not exist"
Oct 30 18:58:13.484418 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.484392    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"]
Oct 30 18:58:13.492144 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:13.492119    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-graph-raw-hpa-6d75d-predictor-546d6dd69f-kvzd4"]
Oct 30 18:58:15.038183 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:15.038150    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e148209-ed28-424d-a759-4c0f041e8073" path="/var/lib/kubelet/pods/1e148209-ed28-424d-a759-4c0f041e8073/volumes"
Oct 30 18:58:17.325457 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:17.325433    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:58:17.325900 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:17.325875    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:58:27.325978 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:27.325928    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:58:34.689649 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:34.689615    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:58:37.326443 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:37.326406    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:58:40.821176 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:58:40.821141    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:58:47.326297 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:47.326254    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:58:57.326402 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:58:57.326366    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:59:07.326563 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:07.326523    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:59:10.821364 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:59:10.821326    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:59:17.327986 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:17.327945    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Oct 30 18:59:27.326409 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:27.326380    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:59:27.966773 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:27.966737    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"]
Oct 30 18:59:27.967008 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:27.966983    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container" containerID="cri-o://bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb" gracePeriod=30
Oct 30 18:59:27.967075 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:27.967013    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kube-rbac-proxy" containerID="cri-o://4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831" gracePeriod=30
Oct 30 18:59:28.603271 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:28.603218    5652 generic.go:356] "Generic (PLEG): container finished" podID="9617177f-128b-4018-ad60-cf8aba71f15d" containerID="4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831" exitCode=0
Oct 30 18:59:28.603271 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:28.603258    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerDied","Data":"4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831"}
Oct 30 18:59:32.322266 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.322202    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.24:8643/healthz\": dial tcp 10.134.0.24:8643: connect: connection refused"
Oct 30 18:59:32.506797 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.506770    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:59:32.618879 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.618814    5652 generic.go:356] "Generic (PLEG): container finished" podID="9617177f-128b-4018-ad60-cf8aba71f15d" containerID="bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb" exitCode=0
Oct 30 18:59:32.618879 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.618871    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"
Oct 30 18:59:32.619032 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.618877    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerDied","Data":"bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb"}
Oct 30 18:59:32.619032 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.618930    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj" event={"ID":"9617177f-128b-4018-ad60-cf8aba71f15d","Type":"ContainerDied","Data":"8eedbcefeaf2b2fe4d1d770bab12e558a1d0d7bcbd6baf514c18a05342490a93"}
Oct 30 18:59:32.619032 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.618956    5652 scope.go:122] "RemoveContainer" containerID="4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831"
Oct 30 18:59:32.626419 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.626404    5652 scope.go:122] "RemoveContainer" containerID="bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb"
Oct 30 18:59:32.633364 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.633346    5652 scope.go:122] "RemoveContainer" containerID="e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024"
Oct 30 18:59:32.639994 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.639978    5652 scope.go:122] "RemoveContainer" containerID="4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831"
Oct 30 18:59:32.640243 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:59:32.640210    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831\": container with ID starting with 4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831 not found: ID does not exist" containerID="4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831"
Oct 30 18:59:32.640305 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.640250    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831"} err="failed to get container status \"4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831\": rpc error: code = NotFound desc = could not find container \"4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831\": container with ID starting with 4672bb9979fa43be0197ad726669ea17f33d537e6ce0cad4a415d1dee2a91831 not found: ID does not exist"
Oct 30 18:59:32.640305 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.640272    5652 scope.go:122] "RemoveContainer" containerID="bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb"
Oct 30 18:59:32.640548 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:59:32.640529    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb\": container with ID starting with bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb not found: ID does not exist" containerID="bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb"
Oct 30 18:59:32.640594 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.640556    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb"} err="failed to get container status \"bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb\": rpc error: code = NotFound desc = could not find container \"bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb\": container with ID starting with bde6b11588cedaed574083065b301127bd1214bc47efceb21a99c70ce8dbcfbb not found: ID does not exist"
Oct 30 18:59:32.640594 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.640574    5652 scope.go:122] "RemoveContainer" containerID="e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024"
Oct 30 18:59:32.640821 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:59:32.640802    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024\": container with ID starting with e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024 not found: ID does not exist" containerID="e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024"
Oct 30 18:59:32.640872 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.640823    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024"} err="failed to get container status \"e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024\": rpc error: code = NotFound desc = could not find container \"e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024\": container with ID starting with e86822f47694df78784e37ca01c152f140fd5893fa44a833e5f5a496022d3024 not found: ID does not exist"
Oct 30 18:59:32.666095 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666072    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls\") pod \"9617177f-128b-4018-ad60-cf8aba71f15d\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") "
Oct 30 18:59:32.666174 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666111    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5\" (UniqueName: \"kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5\") pod \"9617177f-128b-4018-ad60-cf8aba71f15d\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") "
Oct 30 18:59:32.666258 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666218    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config\") pod \"9617177f-128b-4018-ad60-cf8aba71f15d\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") "
Oct 30 18:59:32.666320 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666282    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert\") pod \"9617177f-128b-4018-ad60-cf8aba71f15d\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") "
Oct 30 18:59:32.666320 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666315    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location\") pod \"9617177f-128b-4018-ad60-cf8aba71f15d\" (UID: \"9617177f-128b-4018-ad60-cf8aba71f15d\") "
Oct 30 18:59:32.666558 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666536    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config" pod "9617177f-128b-4018-ad60-cf8aba71f15d" (UID: "9617177f-128b-4018-ad60-cf8aba71f15d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:59:32.666679 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666654    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert" pod "9617177f-128b-4018-ad60-cf8aba71f15d" (UID: "9617177f-128b-4018-ad60-cf8aba71f15d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:59:32.666741 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.666672    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location" pod "9617177f-128b-4018-ad60-cf8aba71f15d" (UID: "9617177f-128b-4018-ad60-cf8aba71f15d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:59:32.668243 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.668208    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls" pod "9617177f-128b-4018-ad60-cf8aba71f15d" (UID: "9617177f-128b-4018-ad60-cf8aba71f15d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:59:32.668576 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.668554    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5" pod "9617177f-128b-4018-ad60-cf8aba71f15d" (UID: "9617177f-128b-4018-ad60-cf8aba71f15d"). InnerVolumeSpecName "kube-api-access-lhnn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:59:32.767533 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.767508    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9617177f-128b-4018-ad60-cf8aba71f15d-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:59:32.767533 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.767530    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhnn5\" (UniqueName: \"kubernetes.io/projected/9617177f-128b-4018-ad60-cf8aba71f15d-kube-api-access-lhnn5\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:59:32.767692 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.767540    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:59:32.767692 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.767550    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9617177f-128b-4018-ad60-cf8aba71f15d-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:59:32.767692 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:32.767559    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9617177f-128b-4018-ad60-cf8aba71f15d-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 18:59:33.037955 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:33.037926    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"]
Oct 30 18:59:33.042280 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:33.042259    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-stop-predictor-594688d7b8-b6gfj"]
Oct 30 18:59:33.192844 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:33.192773    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:59:33.740209 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:33.740177    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:59:35.015817 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:35.015782    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:59:35.038151 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:35.038122    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" path="/var/lib/kubelet/pods/9617177f-128b-4018-ad60-cf8aba71f15d/volumes"
Oct 30 18:59:40.821530 ip-10-0-133-244 kubenswrapper[5652]: E1030 18:59:40.821450    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 18:59:42.334610 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:42.334576    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:59:42.538391 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:42.538360    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:59:42.875010 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:42.874977    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 18:59:43.486936 ip-10-0-133-244 kubenswrapper[5652]: I1030 18:59:43.486903    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:10.820776 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:00:10.820740    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:00:14.463163 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:14.463134    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:15.444626 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:15.444591    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:26.328413 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.328376    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:26.546149 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546118    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"]
Oct 30 19:00:26.546470 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546455    5652 cpu_manager.go:414] "containerMap: removing container" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="storage-initializer"
Oct 30 19:00:26.546520 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546473    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="storage-initializer"
Oct 30 19:00:26.546520 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546484    5652 cpu_manager.go:414] "containerMap: removing container" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kube-rbac-proxy"
Oct 30 19:00:26.546520 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546491    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kube-rbac-proxy"
Oct 30 19:00:26.546520 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546500    5652 cpu_manager.go:414] "containerMap: removing container" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kube-rbac-proxy"
Oct 30 19:00:26.546520 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546505    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kube-rbac-proxy"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546522    5652 cpu_manager.go:414] "containerMap: removing container" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="storage-initializer"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546527    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="storage-initializer"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546546    5652 cpu_manager.go:414] "containerMap: removing container" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546550    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546559    5652 cpu_manager.go:414] "containerMap: removing container" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546563    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546625    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kserve-container"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546631    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kserve-container"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546639    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="9617177f-128b-4018-ad60-cf8aba71f15d" containerName="kube-rbac-proxy"
Oct 30 19:00:26.546706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.546647    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e148209-ed28-424d-a759-4c0f041e8073" containerName="kube-rbac-proxy"
Oct 30 19:00:26.549534 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.549512    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.551249 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.551198    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:26.646426 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.646364    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"kube-root-ca.crt\""
Oct 30 19:00:26.646426 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.646361    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"message-dumper-raw-c5cb2-kube-rbac-proxy-sar-config\""
Oct 30 19:00:26.646569 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.646452    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"message-dumper-raw-c5cb2-predictor-serving-cert\""
Oct 30 19:00:26.647419 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.647398    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"]
Oct 30 19:00:26.655784 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.655767    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.655861 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.655804    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mw6s\" (UniqueName: \"kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.655861 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.655825    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.756246 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.756195    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mw6s\" (UniqueName: \"kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.756362 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.756264    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.756428 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.756361    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.756942 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.756921    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.758752 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.758728    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.815631 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.815606    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mw6s\" (UniqueName: \"kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s\") pod \"message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") " pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:26.863876 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:26.863853    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:27.226033 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:27.225955    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"]
Oct 30 19:00:27.229511 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:00:27.229478    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aeba443_7a2a_43d7_841a_d6cf24429836.slice/crio-634c4bf943b1d99211ff1454193c1a3244840ec6a295355619a7fff322891a2d WatchSource:0}: Error finding container 634c4bf943b1d99211ff1454193c1a3244840ec6a295355619a7fff322891a2d: Status 404 returned error can't find the container with id 634c4bf943b1d99211ff1454193c1a3244840ec6a295355619a7fff322891a2d
Oct 30 19:00:27.231450 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:27.231434    5652 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:00:27.815908 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:27.815873    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" event={"ID":"3aeba443-7a2a-43d7-841a-d6cf24429836","Type":"ContainerStarted","Data":"634c4bf943b1d99211ff1454193c1a3244840ec6a295355619a7fff322891a2d"}
Oct 30 19:00:28.824083 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:28.824040    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" event={"ID":"3aeba443-7a2a-43d7-841a-d6cf24429836","Type":"ContainerStarted","Data":"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"}
Oct 30 19:00:28.824529 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:28.824251    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:28.824529 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:28.824305    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:28.824529 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:28.824329    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" event={"ID":"3aeba443-7a2a-43d7-841a-d6cf24429836","Type":"ContainerStarted","Data":"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"}
Oct 30 19:00:28.825643 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:28.825623    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:28.964956 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:28.964872    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" podStartSLOduration=1.558362322 podStartE2EDuration="2.964859705s" totalImagesPullingTime="1.406497383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:00:28.96405935 +0000 UTC m=+1318.044729722" watchObservedRunningTime="2026-10-30 19:00:28.964859705 +0000 UTC m=+1318.045530076"
Oct 30 19:00:29.456633 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:29.456597    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:35.403603 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:35.403551    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:35.836664 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:35.836636    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:00:40.820522 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:00:40.820491    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:00:46.548689 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:46.548647    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:46.737813 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:46.737785    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:00:47.140368 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.140333    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"]
Oct 30 19:00:47.145326 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.145303    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.196584 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.196560    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"seaweedfs-s3-creds\""
Oct 30 19:00:47.211052 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.211030    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.211116 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.211070    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76rpg\" (UniqueName: \"kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.211116 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.211093    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.211183 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.211153    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.211244 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.211182    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.241017 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.240996    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:00:47.241104 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.241029    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-logger-raw-c5cb2-predictor-serving-cert\""
Oct 30 19:00:47.241104 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.241083    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-logger-raw-c5cb2-kube-rbac-proxy-sar-config\""
Oct 30 19:00:47.241971 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.241953    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"]
Oct 30 19:00:47.312492 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.312467    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76rpg\" (UniqueName: \"kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.312601 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.312498    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.312601 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.312519    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.312601 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.312546    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.312756 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.312600    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.312932 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.312915    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.313191 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.313170    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.313340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.313322    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.315088 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.315070    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.372872 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.372844    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76rpg\" (UniqueName: \"kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg\") pod \"isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") " pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.464039 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.463977    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:47.880460 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.880431    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"]
Oct 30 19:00:47.883356 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:00:47.883326    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedc6abf_5d6d_4d88_a65d_07bb91101db7.slice/crio-f82ba3bd048e1c96fa175342a856a00bf5ecef1bdc0bfc92b24a28ba070ed9a3 WatchSource:0}: Error finding container f82ba3bd048e1c96fa175342a856a00bf5ecef1bdc0bfc92b24a28ba070ed9a3: Status 404 returned error can't find the container with id f82ba3bd048e1c96fa175342a856a00bf5ecef1bdc0bfc92b24a28ba070ed9a3
Oct 30 19:00:47.891693 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:47.891666    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerStarted","Data":"f82ba3bd048e1c96fa175342a856a00bf5ecef1bdc0bfc92b24a28ba070ed9a3"}
Oct 30 19:00:48.896928 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:48.896894    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerStarted","Data":"86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99"}
Oct 30 19:00:51.912125 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:51.912092    5652 generic.go:356] "Generic (PLEG): container finished" podID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerID="86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99" exitCode=0
Oct 30 19:00:51.912558 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:51.912156    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerDied","Data":"86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99"}
Oct 30 19:00:52.918264 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:52.918209    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerStarted","Data":"38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba"}
Oct 30 19:00:52.918661 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:52.918298    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerStarted","Data":"eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc"}
Oct 30 19:00:52.918661 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:52.918326    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerStarted","Data":"dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5"}
Oct 30 19:00:52.918661 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:52.918600    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:52.918661 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:52.918650    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:52.920095 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:52.920066    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:00:53.035126 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:53.035089    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podStartSLOduration=2.1866846620000002 podStartE2EDuration="6.035078034s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.848393372s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:00:53.034811742 +0000 UTC m=+1342.115482172" watchObservedRunningTime="2026-10-30 19:00:53.035078034 +0000 UTC m=+1342.115748405"
Oct 30 19:00:53.921726 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:53.921684    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:53.922104 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:53.921693    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:00:53.922826 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:53.922798    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:00:54.924951 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:54.924911    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:00:54.925376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:54.925359    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:00:59.929760 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:59.929731    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:00:59.930283 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:59.930217    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:00:59.930543 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:00:59.930518    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:09.930451 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:09.930405    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:01:09.930947 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:09.930887    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:10.820188 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:01:10.820109    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:01:19.930685 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:19.930643    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:01:19.931198 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:19.931160    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:29.930910 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:29.930865    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:01:29.931424 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:29.931322    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:35.759143 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:35.759110    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:01:38.276433 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:38.276398    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:01:38.467031 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:38.466995    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:01:39.930257 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:39.930197    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:01:39.930768 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:39.930747    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:40.823673 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:01:40.823636    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:01:49.931024 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:49.930984    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:01:49.931506 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:49.931479    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:59.930338 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:59.930298    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:01:59.930823 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:59.930799    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:01:59.985667 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:01:59.985636    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:00.177493 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:00.177464    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:07.037852 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:07.037823    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:07.038204 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:07.037896    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:07.466317 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:07.466287    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:07.710894 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:07.710859    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:10.820461 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:10.820424    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:02:17.510019 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:17.509979    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:21.422197 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:21.422167    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-1fd37956ac_message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h_3aeba443-7a2a-43d7-841a-d6cf24429836/kserve-container/0.log"
Oct 30 19:02:22.999009 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:22.994740    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"]
Oct 30 19:02:22.999540 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:22.999269    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" containerID="cri-o://38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba" gracePeriod=30
Oct 30 19:02:22.999632 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:22.999445    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" containerID="cri-o://eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc" gracePeriod=30
Oct 30 19:02:22.999769 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:22.999494    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" containerID="cri-o://dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5" gracePeriod=30
Oct 30 19:02:23.041817 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:23.041795    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:23.256294 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:23.256209    5652 generic.go:356] "Generic (PLEG): container finished" podID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerID="eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc" exitCode=0
Oct 30 19:02:23.256294 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:23.256260    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerDied","Data":"eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc"}
Oct 30 19:02:23.841581 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:23.841545    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:24.048103 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.048066    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:24.523387 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.523354    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"]
Oct 30 19:02:24.523635 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.523613    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kserve-container" containerID="cri-o://05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1" gracePeriod=30
Oct 30 19:02:24.523723 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.523686    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kube-rbac-proxy" containerID="cri-o://40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e" gracePeriod=30
Oct 30 19:02:24.604010 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.603987    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:24.775450 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.775388    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:02:24.925964 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.925924    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Oct 30 19:02:24.950847 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.950820    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls\") pod \"3aeba443-7a2a-43d7-841a-d6cf24429836\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") "
Oct 30 19:02:24.950948 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.950910    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config\") pod \"3aeba443-7a2a-43d7-841a-d6cf24429836\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") "
Oct 30 19:02:24.950948 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.950942    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s\" (UniqueName: \"kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s\") pod \"3aeba443-7a2a-43d7-841a-d6cf24429836\" (UID: \"3aeba443-7a2a-43d7-841a-d6cf24429836\") "
Oct 30 19:02:24.951374 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.951338    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config" pod "3aeba443-7a2a-43d7-841a-d6cf24429836" (UID: "3aeba443-7a2a-43d7-841a-d6cf24429836"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:02:24.952867 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.952840    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls" pod "3aeba443-7a2a-43d7-841a-d6cf24429836" (UID: "3aeba443-7a2a-43d7-841a-d6cf24429836"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:02:24.952988 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:24.952877    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s" pod "3aeba443-7a2a-43d7-841a-d6cf24429836" (UID: "3aeba443-7a2a-43d7-841a-d6cf24429836"). InnerVolumeSpecName "kube-api-access-6mw6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:02:25.051603 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.051583    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3aeba443-7a2a-43d7-841a-d6cf24429836-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:25.051886 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.051605    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:25.051886 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.051618    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mw6s\" (UniqueName: \"kubernetes.io/projected/3aeba443-7a2a-43d7-841a-d6cf24429836-kube-api-access-6mw6s\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:25.266417 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266382    5652 generic.go:356] "Generic (PLEG): container finished" podID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerID="40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e" exitCode=0
Oct 30 19:02:25.266417 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266410    5652 generic.go:356] "Generic (PLEG): container finished" podID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerID="05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1" exitCode=2
Oct 30 19:02:25.266608 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266447    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"
Oct 30 19:02:25.266608 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266466    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" event={"ID":"3aeba443-7a2a-43d7-841a-d6cf24429836","Type":"ContainerDied","Data":"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"}
Oct 30 19:02:25.266608 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266534    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" event={"ID":"3aeba443-7a2a-43d7-841a-d6cf24429836","Type":"ContainerDied","Data":"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"}
Oct 30 19:02:25.266608 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266565    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h" event={"ID":"3aeba443-7a2a-43d7-841a-d6cf24429836","Type":"ContainerDied","Data":"634c4bf943b1d99211ff1454193c1a3244840ec6a295355619a7fff322891a2d"}
Oct 30 19:02:25.266608 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.266599    5652 scope.go:122] "RemoveContainer" containerID="40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"
Oct 30 19:02:25.274514 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.274496    5652 scope.go:122] "RemoveContainer" containerID="05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"
Oct 30 19:02:25.282003 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.281985    5652 scope.go:122] "RemoveContainer" containerID="40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"
Oct 30 19:02:25.282261 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:25.282241    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e\": container with ID starting with 40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e not found: ID does not exist" containerID="40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"
Oct 30 19:02:25.282328 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282268    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"} err="failed to get container status \"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e\": rpc error: code = NotFound desc = could not find container \"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e\": container with ID starting with 40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e not found: ID does not exist"
Oct 30 19:02:25.282328 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282285    5652 scope.go:122] "RemoveContainer" containerID="05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"
Oct 30 19:02:25.282530 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:25.282512    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1\": container with ID starting with 05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1 not found: ID does not exist" containerID="05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"
Oct 30 19:02:25.282570 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282538    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"} err="failed to get container status \"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1\": rpc error: code = NotFound desc = could not find container \"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1\": container with ID starting with 05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1 not found: ID does not exist"
Oct 30 19:02:25.282570 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282556    5652 scope.go:122] "RemoveContainer" containerID="40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"
Oct 30 19:02:25.282776 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282759    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e"} err="failed to get container status \"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e\": rpc error: code = NotFound desc = could not find container \"40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e\": container with ID starting with 40c55b539ea3601450ae65755d198fa78ea1b24f770a5b612d2286031ed69d7e not found: ID does not exist"
Oct 30 19:02:25.282826 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282776    5652 scope.go:122] "RemoveContainer" containerID="05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"
Oct 30 19:02:25.282975 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.282958    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1"} err="failed to get container status \"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1\": rpc error: code = NotFound desc = could not find container \"05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1\": container with ID starting with 05672dfcdfd783dfcb9cb277d90e7721cd874aa28291e6d695cb15d3780982c1 not found: ID does not exist"
Oct 30 19:02:25.422930 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.422908    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"]
Oct 30 19:02:25.468985 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:25.468963    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/message-dumper-raw-c5cb2-predictor-6d6f46769b-zx49h"]
Oct 30 19:02:27.034333 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:27.034287    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:02:27.034805 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:27.034635    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:02:27.037703 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:27.037681    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" path="/var/lib/kubelet/pods/3aeba443-7a2a-43d7-841a-d6cf24429836/volumes"
Oct 30 19:02:28.280795 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:28.280758    5652 generic.go:356] "Generic (PLEG): container finished" podID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerID="dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5" exitCode=0
Oct 30 19:02:28.281136 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:28.280828    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerDied","Data":"dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5"}
Oct 30 19:02:29.925576 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:29.925533    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Oct 30 19:02:34.925679 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:34.925629    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Oct 30 19:02:34.927686 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:34.925772    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:36.062076 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:36.062047    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:02:37.034392 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:37.034341    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:02:37.034759 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:37.034723    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:02:39.925508 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:39.925468    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Oct 30 19:02:40.821114 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:40.821042    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:02:44.925655 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:44.925608    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Oct 30 19:02:47.034471 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:47.034417    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 19:02:47.034965 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:47.034730    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:02:47.037728 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:47.037706    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:47.037858 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:47.037810    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:49.925194 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:49.925158    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Oct 30 19:02:53.138399 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.138375    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:53.247915 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.247891    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location\") pod \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") "
Oct 30 19:02:53.248032 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.247928    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config\") pod \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") "
Oct 30 19:02:53.248032 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.247968    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg\" (UniqueName: \"kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg\") pod \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") "
Oct 30 19:02:53.248032 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.247994    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls\") pod \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") "
Oct 30 19:02:53.248032 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.248012    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert\") pod \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\" (UID: \"fedc6abf-5d6d-4d88-a65d-07bb91101db7\") "
Oct 30 19:02:53.248333 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.248301    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location" pod "fedc6abf-5d6d-4d88-a65d-07bb91101db7" (UID: "fedc6abf-5d6d-4d88-a65d-07bb91101db7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:02:53.248406 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.248381    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config" pod "fedc6abf-5d6d-4d88-a65d-07bb91101db7" (UID: "fedc6abf-5d6d-4d88-a65d-07bb91101db7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:02:53.248453 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.248432    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert" pod "fedc6abf-5d6d-4d88-a65d-07bb91101db7" (UID: "fedc6abf-5d6d-4d88-a65d-07bb91101db7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:02:53.250014 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.249993    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg" pod "fedc6abf-5d6d-4d88-a65d-07bb91101db7" (UID: "fedc6abf-5d6d-4d88-a65d-07bb91101db7"). InnerVolumeSpecName "kube-api-access-76rpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:02:53.250099 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.250085    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls" pod "fedc6abf-5d6d-4d88-a65d-07bb91101db7" (UID: "fedc6abf-5d6d-4d88-a65d-07bb91101db7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:02:53.348591 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.348569    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:53.348591 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.348594    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:53.348737 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.348606    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76rpg\" (UniqueName: \"kubernetes.io/projected/fedc6abf-5d6d-4d88-a65d-07bb91101db7-kube-api-access-76rpg\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:53.348737 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.348615    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fedc6abf-5d6d-4d88-a65d-07bb91101db7-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:53.348737 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.348627    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fedc6abf-5d6d-4d88-a65d-07bb91101db7-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:02:53.373963 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.373939    5652 generic.go:356] "Generic (PLEG): container finished" podID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerID="38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba" exitCode=0
Oct 30 19:02:53.374079 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.373982    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerDied","Data":"38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba"}
Oct 30 19:02:53.374079 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.374003    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"
Oct 30 19:02:53.374079 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.374043    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr" event={"ID":"fedc6abf-5d6d-4d88-a65d-07bb91101db7","Type":"ContainerDied","Data":"f82ba3bd048e1c96fa175342a856a00bf5ecef1bdc0bfc92b24a28ba070ed9a3"}
Oct 30 19:02:53.374079 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.374074    5652 scope.go:122] "RemoveContainer" containerID="38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba"
Oct 30 19:02:53.381999 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.381980    5652 scope.go:122] "RemoveContainer" containerID="eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc"
Oct 30 19:02:53.388979 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.388963    5652 scope.go:122] "RemoveContainer" containerID="dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5"
Oct 30 19:02:53.396000 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.395983    5652 scope.go:122] "RemoveContainer" containerID="86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99"
Oct 30 19:02:53.402407 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.402387    5652 scope.go:122] "RemoveContainer" containerID="38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba"
Oct 30 19:02:53.402652 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:53.402637    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba\": container with ID starting with 38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba not found: ID does not exist" containerID="38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba"
Oct 30 19:02:53.402700 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.402659    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba"} err="failed to get container status \"38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba\": rpc error: code = NotFound desc = could not find container \"38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba\": container with ID starting with 38b56ff5efa8bd74bae1453b69b4fc74ee5d97130d361a42330204636c1a1cba not found: ID does not exist"
Oct 30 19:02:53.402700 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.402678    5652 scope.go:122] "RemoveContainer" containerID="eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc"
Oct 30 19:02:53.402912 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:53.402895    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc\": container with ID starting with eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc not found: ID does not exist" containerID="eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc"
Oct 30 19:02:53.402964 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.402915    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc"} err="failed to get container status \"eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc\": rpc error: code = NotFound desc = could not find container \"eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc\": container with ID starting with eb6b9007dbd90e1a6aa2b929bf6771d142195ca15c6a2a0dee21d8cbdb6e28dc not found: ID does not exist"
Oct 30 19:02:53.402964 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.402927    5652 scope.go:122] "RemoveContainer" containerID="dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5"
Oct 30 19:02:53.403128 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:53.403114    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5\": container with ID starting with dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5 not found: ID does not exist" containerID="dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5"
Oct 30 19:02:53.403167 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.403131    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5"} err="failed to get container status \"dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5\": rpc error: code = NotFound desc = could not find container \"dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5\": container with ID starting with dac8ff19ace9947087da80b36abe348437f0d34961e155039b5e4d432a8a94f5 not found: ID does not exist"
Oct 30 19:02:53.403167 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.403142    5652 scope.go:122] "RemoveContainer" containerID="86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99"
Oct 30 19:02:53.403643 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:02:53.403620    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99\": container with ID starting with 86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99 not found: ID does not exist" containerID="86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99"
Oct 30 19:02:53.403710 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.403648    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99"} err="failed to get container status \"86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99\": rpc error: code = NotFound desc = could not find container \"86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99\": container with ID starting with 86cc6e4ccd734f5f25b00a6217114a67f6f7426005aae102ea24a308ef5dbe99 not found: ID does not exist"
Oct 30 19:02:53.532840 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.532787    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"]
Oct 30 19:02:53.538954 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:53.538930    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-logger-raw-c5cb2-predictor-5864745499-tp9lr"]
Oct 30 19:02:55.042920 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:02:55.039504    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" path="/var/lib/kubelet/pods/fedc6abf-5d6d-4d88-a65d-07bb91101db7/volumes"
Oct 30 19:03:10.820568 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:03:10.820531    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:03:36.397113 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:03:36.397079    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:03:37.512500 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:03:37.512462    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:03:37.927303 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:03:37.927273    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:03:40.819794 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:03:40.819761    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:03:54.876574 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:03:54.876538    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:04:03.257945 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:04:03.257912    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:04:03.580778 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:04:03.580747    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:04:03.961742 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:04:03.961670    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:04:05.003191 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:04:05.003156    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:04:10.821259 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:04:10.821170    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:04:36.785714 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:04:36.785678    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:04:40.819970 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:04:40.819932    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:05:08.955565 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:08.955533    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:09.150840 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.150812    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:09.383043 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383008    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"]
Oct 30 19:05:09.383327 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383313    5652 cpu_manager.go:414] "containerMap: removing container" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383328    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383341    5652 cpu_manager.go:414] "containerMap: removing container" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383346    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383359    5652 cpu_manager.go:414] "containerMap: removing container" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kserve-container"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383364    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kserve-container"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383371    5652 cpu_manager.go:414] "containerMap: removing container" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container"
Oct 30 19:05:09.383376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383375    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383385    5652 cpu_manager.go:414] "containerMap: removing container" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kube-rbac-proxy"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383399    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kube-rbac-proxy"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383413    5652 cpu_manager.go:414] "containerMap: removing container" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="storage-initializer"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383418    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="storage-initializer"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383465    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kube-rbac-proxy"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383472    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="agent"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383481    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kserve-container"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383486    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="fedc6abf-5d6d-4d88-a65d-07bb91101db7" containerName="kserve-container"
Oct 30 19:05:09.383629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.383492    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="3aeba443-7a2a-43d7-841a-d6cf24429836" containerName="kube-rbac-proxy"
Oct 30 19:05:09.386490 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.386472    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.437274 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.437249    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"seaweedfs-s3-creds\""
Oct 30 19:05:09.482629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.482601    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:05:09.482629 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.482622    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"kube-root-ca.crt\""
Oct 30 19:05:09.482786 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.482654    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-sklearn-scale-raw-3e8ba-predictor-serving-cert\""
Oct 30 19:05:09.482786 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.482665    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-1fd37956ac\"/\"isvc-sklearn-scale-raw-3e8ba-kube-rbac-proxy-sar-config\""
Oct 30 19:05:09.483522 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.483504    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"]
Oct 30 19:05:09.519735 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.519714    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbtr\" (UniqueName: \"kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.519834 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.519746    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.519834 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.519771    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.519834 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.519827    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.520006 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.519964    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621089 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621062    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbtr\" (UniqueName: \"kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621252 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621103    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621304 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621262    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621345 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621301    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621390 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621352    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621550 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621533    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.621946 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621922    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.622045 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.621949    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.623660 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.623636    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.682667 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.682609    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbtr\" (UniqueName: \"kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr\") pod \"isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") " pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:09.702492 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:09.702470    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:10.111764 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:10.111736    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"]
Oct 30 19:05:10.115528 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:05:10.115494    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae03b715_46cc_4133_bb34_402ef5688056.slice/crio-bb504dd641c7670bc2c8b8a4a67d946459bbad0ee80f5732d43df4b72ddf235b WatchSource:0}: Error finding container bb504dd641c7670bc2c8b8a4a67d946459bbad0ee80f5732d43df4b72ddf235b: Status 404 returned error can't find the container with id bb504dd641c7670bc2c8b8a4a67d946459bbad0ee80f5732d43df4b72ddf235b
Oct 30 19:05:10.821164 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:05:10.821121    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:05:10.865699 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:10.865674    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerStarted","Data":"fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9"}
Oct 30 19:05:10.865856 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:10.865731    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerStarted","Data":"bb504dd641c7670bc2c8b8a4a67d946459bbad0ee80f5732d43df4b72ddf235b"}
Oct 30 19:05:11.079668 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:11.079604    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:12.204169 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:12.204131    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:14.880699 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:14.880664    5652 generic.go:356] "Generic (PLEG): container finished" podID="ae03b715-46cc-4133-bb34-402ef5688056" containerID="fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9" exitCode=0
Oct 30 19:05:14.881086 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:14.880713    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerDied","Data":"fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9"}
Oct 30 19:05:15.885963 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:15.885932    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerStarted","Data":"81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30"}
Oct 30 19:05:15.886405 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:15.885990    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerStarted","Data":"d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca"}
Oct 30 19:05:15.886405 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:15.886180    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:16.001105 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:16.001060    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podStartSLOduration=3.047307125 podStartE2EDuration="7.001046686s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.953739561s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:05:16.000099613 +0000 UTC m=+1605.080770016" watchObservedRunningTime="2026-10-30 19:05:16.001046686 +0000 UTC m=+1605.081717131"
Oct 30 19:05:16.889216 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:16.889177    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:16.890372 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:16.890348    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:05:17.892421 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:17.892382    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:05:22.897387 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:22.897356    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:05:22.897994 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:22.897968    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:05:32.897924 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:32.897884    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:05:34.347883 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:34.347854    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:37.067602 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:37.067572    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:39.695407 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:39.695357    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:40.821275 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:05:40.821182    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:05:42.898650 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:42.898615    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:05:42.950909 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:42.950879    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:43.141848 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.141818    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:43.489048 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.489019    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:43.677349 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.677318    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:05:43.937075 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.937044    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"]
Oct 30 19:05:43.940623 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.940597    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:43.968247 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.968211    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:43.968342 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.968294    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:43.968342 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.968319    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:43.968438 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.968345    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbx2f\" (UniqueName: \"kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:43.968475 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.968461    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:43.992182 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:43.992160    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"openshift-service-ca.crt\""
Oct 30 19:05:44.036825 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.036807    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"seaweedfs-s3-creds\""
Oct 30 19:05:44.036992 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.036968    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"kube-root-ca.crt\""
Oct 30 19:05:44.036992 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.036969    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:05:44.037158 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.036995    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"default-dockercfg-zc4kv\""
Oct 30 19:05:44.037158 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.037000    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-create-predictor-serving-cert\""
Oct 30 19:05:44.037158 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.037001    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Oct 30 19:05:44.038064 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.038047    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"]
Oct 30 19:05:44.068987 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.068965    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbx2f\" (UniqueName: \"kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069078 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069005    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069078 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069055    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069192 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069079    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069192 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069096    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069577 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069549    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069755 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069736    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.069815 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.069772    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.071424 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.071406    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.128425 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.128400    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbx2f\" (UniqueName: \"kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f\") pod \"isvc-canary-create-predictor-8b6998fb4-qw2s7\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") " pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.256695 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.256635    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:44.668926 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.668893    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"]
Oct 30 19:05:44.671654 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:05:44.671626    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4f0a45_dfef_4849_8cc7_b9d7bad9022e.slice/crio-2949e1adb258cb258ad566a7f3ecfe50d00b3e093b46722061a89617bf036942 WatchSource:0}: Error finding container 2949e1adb258cb258ad566a7f3ecfe50d00b3e093b46722061a89617bf036942: Status 404 returned error can't find the container with id 2949e1adb258cb258ad566a7f3ecfe50d00b3e093b46722061a89617bf036942
Oct 30 19:05:44.986672 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.986597    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerStarted","Data":"2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f"}
Oct 30 19:05:44.986672 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:44.986650    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerStarted","Data":"2949e1adb258cb258ad566a7f3ecfe50d00b3e093b46722061a89617bf036942"}
Oct 30 19:05:49.001839 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:49.001802    5652 generic.go:356] "Generic (PLEG): container finished" podID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerID="2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f" exitCode=0
Oct 30 19:05:49.002283 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:49.001850    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerDied","Data":"2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f"}
Oct 30 19:05:50.007662 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:50.007627    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerStarted","Data":"5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780"}
Oct 30 19:05:50.008082 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:50.007691    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerStarted","Data":"8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0"}
Oct 30 19:05:50.008082 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:50.007897    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:50.123060 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:50.123014    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podStartSLOduration=3.448536988 podStartE2EDuration="7.122998343s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.674461355s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:05:50.122174267 +0000 UTC m=+1639.202844641" watchObservedRunningTime="2026-10-30 19:05:50.122998343 +0000 UTC m=+1639.203668720"
Oct 30 19:05:51.012292 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:51.012261    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:51.013618 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:51.013589    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:05:52.015829 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:52.015787    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:05:52.898712 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:52.898676    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:05:57.020368 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:57.020340    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:05:57.020930 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:05:57.020904    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:06:02.898221 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:02.898180    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:06:07.021242 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:07.021180    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:06:10.820768 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:06:10.820735    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:06:12.897997 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:12.897962    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:06:17.021342 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:17.021306    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:06:22.898295 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:22.898256    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:06:27.020906 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:27.020862    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:06:32.897962 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:32.897924    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:06:37.021545 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:37.021508    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:06:37.457289 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:37.457253    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:06:40.821451 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:06:40.821406    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:06:42.898068 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:42.898035    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:06:47.021009 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:47.020964    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:06:50.033750 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:50.033708    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:06:57.021660 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:06:57.021620    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:07:00.034551 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:00.034507    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:07:04.034064 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:04.034023    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:07:10.033625 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:10.033584    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:07:10.820871 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:07:10.820795    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:07:14.034877 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:14.034852    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:07:20.034621 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:20.034584    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:07:23.689651 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:23.689621    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"]
Oct 30 19:07:23.690064 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:23.689852    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" containerID="cri-o://8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0" gracePeriod=30
Oct 30 19:07:23.690064 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:23.689871    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kube-rbac-proxy" containerID="cri-o://5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780" gracePeriod=30
Oct 30 19:07:23.746680 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:23.746654    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:23.938760 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:23.938734    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:24.035062 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:24.034994    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 19:07:24.355585 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:24.355557    5652 generic.go:356] "Generic (PLEG): container finished" podID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerID="5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780" exitCode=0
Oct 30 19:07:24.355733 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:24.355599    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerDied","Data":"5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780"}
Oct 30 19:07:27.016330 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:27.016222    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Oct 30 19:07:28.024705 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.024682    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:07:28.107882 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.107855    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls\") pod \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") "
Oct 30 19:07:28.108009 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.107899    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert\") pod \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") "
Oct 30 19:07:28.108009 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.107948    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location\") pod \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") "
Oct 30 19:07:28.108009 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.107992    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f\" (UniqueName: \"kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f\") pod \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") "
Oct 30 19:07:28.108180 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.108037    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config\") pod \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\" (UID: \"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e\") "
Oct 30 19:07:28.108312 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.108283    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location" pod "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" (UID: "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:07:28.108447 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.108427    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert" pod "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" (UID: "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:07:28.108546 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.108520    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config" pod "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" (UID: "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:07:28.109927 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.109904    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls" pod "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" (UID: "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:07:28.110010 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.109997    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f" pod "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" (UID: "1d4f0a45-dfef-4849-8cc7-b9d7bad9022e"). InnerVolumeSpecName "kube-api-access-gbx2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:07:28.208806 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.208741    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:07:28.208806 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.208769    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:07:28.208806 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.208782    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:07:28.208806 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.208796    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:07:28.209002 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.208811    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbx2f\" (UniqueName: \"kubernetes.io/projected/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e-kube-api-access-gbx2f\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:07:28.372665 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.372638    5652 generic.go:356] "Generic (PLEG): container finished" podID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerID="8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0" exitCode=0
Oct 30 19:07:28.372793 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.372696    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"
Oct 30 19:07:28.372793 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.372706    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerDied","Data":"8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0"}
Oct 30 19:07:28.372793 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.372753    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7" event={"ID":"1d4f0a45-dfef-4849-8cc7-b9d7bad9022e","Type":"ContainerDied","Data":"2949e1adb258cb258ad566a7f3ecfe50d00b3e093b46722061a89617bf036942"}
Oct 30 19:07:28.372793 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.372777    5652 scope.go:122] "RemoveContainer" containerID="5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780"
Oct 30 19:07:28.381099 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.381083    5652 scope.go:122] "RemoveContainer" containerID="8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0"
Oct 30 19:07:28.388251 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.388235    5652 scope.go:122] "RemoveContainer" containerID="2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f"
Oct 30 19:07:28.394922 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.394907    5652 scope.go:122] "RemoveContainer" containerID="5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780"
Oct 30 19:07:28.395158 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:07:28.395137    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780\": container with ID starting with 5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780 not found: ID does not exist" containerID="5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780"
Oct 30 19:07:28.395197 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.395169    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780"} err="failed to get container status \"5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780\": rpc error: code = NotFound desc = could not find container \"5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780\": container with ID starting with 5452a7e077ea80a9c668551daaf8302238dfdfb5effdb28aa0f3b6515ca54780 not found: ID does not exist"
Oct 30 19:07:28.395197 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.395193    5652 scope.go:122] "RemoveContainer" containerID="8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0"
Oct 30 19:07:28.395448 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:07:28.395431    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0\": container with ID starting with 8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0 not found: ID does not exist" containerID="8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0"
Oct 30 19:07:28.395493 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.395453    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0"} err="failed to get container status \"8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0\": rpc error: code = NotFound desc = could not find container \"8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0\": container with ID starting with 8e64da0df0b9ceb32770e21b355674264b719dff347ca3a688dbc36086bc6cc0 not found: ID does not exist"
Oct 30 19:07:28.395493 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.395468    5652 scope.go:122] "RemoveContainer" containerID="2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f"
Oct 30 19:07:28.395681 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:07:28.395664    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f\": container with ID starting with 2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f not found: ID does not exist" containerID="2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f"
Oct 30 19:07:28.395725 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.395685    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f"} err="failed to get container status \"2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f\": rpc error: code = NotFound desc = could not find container \"2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f\": container with ID starting with 2a9d21786690d1f57f28c369e503eb5dfed4f87487eae839f2f15d81b50e938f not found: ID does not exist"
Oct 30 19:07:28.543515 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.543447    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"]
Oct 30 19:07:28.549939 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:28.549918    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-create-predictor-8b6998fb4-qw2s7"]
Oct 30 19:07:29.037353 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:29.037323    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" path="/var/lib/kubelet/pods/1d4f0a45-dfef-4849-8cc7-b9d7bad9022e/volumes"
Oct 30 19:07:30.033632 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:30.033593    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:07:32.071777 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:32.071745    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:32.388510 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:32.388430    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:32.613817 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:32.613784    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:32.860516 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:32.860476    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:33.044858 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.044828    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"]
Oct 30 19:07:33.045133 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045122    5652 cpu_manager.go:414] "containerMap: removing container" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container"
Oct 30 19:07:33.045177 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045136    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container"
Oct 30 19:07:33.045177 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045153    5652 cpu_manager.go:414] "containerMap: removing container" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kube-rbac-proxy"
Oct 30 19:07:33.045177 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045159    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kube-rbac-proxy"
Oct 30 19:07:33.045177 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045168    5652 cpu_manager.go:414] "containerMap: removing container" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="storage-initializer"
Oct 30 19:07:33.045177 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045172    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="storage-initializer"
Oct 30 19:07:33.045343 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045245    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kserve-container"
Oct 30 19:07:33.045343 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.045254    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d4f0a45-dfef-4849-8cc7-b9d7bad9022e" containerName="kube-rbac-proxy"
Oct 30 19:07:33.050115 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.050095    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.148618 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.148554    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.148618 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.148585    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.148618 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.148606    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.149119 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.148755    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.149119 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.148840    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvdb\" (UniqueName: \"kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.156437 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156413    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"openshift-service-ca.crt\""
Oct 30 19:07:33.156649 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156633    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:07:33.156783 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156663    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Oct 30 19:07:33.156783 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156774    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"default-dockercfg-zc4kv\""
Oct 30 19:07:33.156918 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156698    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"seaweedfs-s3-creds\""
Oct 30 19:07:33.156918 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156738    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-promote-predictor-serving-cert\""
Oct 30 19:07:33.156918 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.156669    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-e43a086b9d\"/\"kube-root-ca.crt\""
Oct 30 19:07:33.157368 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.157353    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"]
Oct 30 19:07:33.250097 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250069    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.250263 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250125    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvdb\" (UniqueName: \"kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.250263 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250162    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.250263 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250181    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.250263 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250208    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.250682 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250655    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.250981 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250961    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.251049 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.250962    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.252621 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.252602    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.315791 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.315759    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvdb\" (UniqueName: \"kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb\") pod \"isvc-canary-promote-predictor-659547d46-fnl2n\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.366680 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.366656    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:33.786437 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:07:33.786403    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2d217a_8c76_4a2e_9d43_486d245d762b.slice/crio-aabbb23887d8091a9c936c7c30857f06d493b9645a54342551e62cfff34e84cf WatchSource:0}: Error finding container aabbb23887d8091a9c936c7c30857f06d493b9645a54342551e62cfff34e84cf: Status 404 returned error can't find the container with id aabbb23887d8091a9c936c7c30857f06d493b9645a54342551e62cfff34e84cf
Oct 30 19:07:33.786928 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:33.786908    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"]
Oct 30 19:07:34.396829 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:34.396794    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerStarted","Data":"20567354d38ad53aafa36972111b6586afc4d6dee1a7d64459a904a1c44553f8"}
Oct 30 19:07:34.397207 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:34.396860    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerStarted","Data":"aabbb23887d8091a9c936c7c30857f06d493b9645a54342551e62cfff34e84cf"}
Oct 30 19:07:37.744779 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:37.744721    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:07:38.413876 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:38.413842    5652 generic.go:356] "Generic (PLEG): container finished" podID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerID="20567354d38ad53aafa36972111b6586afc4d6dee1a7d64459a904a1c44553f8" exitCode=0
Oct 30 19:07:38.414064 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:38.413899    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerDied","Data":"20567354d38ad53aafa36972111b6586afc4d6dee1a7d64459a904a1c44553f8"}
Oct 30 19:07:39.419912 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:39.419880    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerStarted","Data":"fdf79023f5b713c7c5fbe85f67b7c26f1753204b96d51f87bf94c32e0000b8e9"}
Oct 30 19:07:39.420388 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:39.419948    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerStarted","Data":"07f89141116941be3b0b1eb22f85b242c26782db444bac27004e833a721c88a5"}
Oct 30 19:07:39.420388 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:39.420174    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:39.544210 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:39.544160    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podStartSLOduration=3.855365762 podStartE2EDuration="7.544148748s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.688782986s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:07:39.543891105 +0000 UTC m=+1748.624561477" watchObservedRunningTime="2026-10-30 19:07:39.544148748 +0000 UTC m=+1748.624819099"
Oct 30 19:07:40.033857 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:40.033811    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:07:40.423734 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:40.423703    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:40.425038 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:40.425011    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:07:40.820742 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:07:40.820708    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:07:41.427430 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:41.427392    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:07:46.432604 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:46.432565    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:07:46.433142 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:46.433117    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:07:50.034244 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:50.034191    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 19:07:56.434032 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:07:56.433995    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:00.034416 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:00.034383    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:08:06.434045 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:06.434000    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:10.711922 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:10.711890    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"]
Oct 30 19:08:10.712332 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:10.712112    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" containerID="cri-o://d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca" gracePeriod=30
Oct 30 19:08:10.712332 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:10.712148    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kube-rbac-proxy" containerID="cri-o://81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30" gracePeriod=30
Oct 30 19:08:10.772906 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:10.772882    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:08:10.820086 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:08:10.820059    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:08:11.536577 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:11.536544    5652 generic.go:356] "Generic (PLEG): container finished" podID="ae03b715-46cc-4133-bb34-402ef5688056" containerID="81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30" exitCode=0
Oct 30 19:08:11.536577 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:11.536579    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerDied","Data":"81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30"}
Oct 30 19:08:12.892854 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:12.892814    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Oct 30 19:08:16.433443 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:16.433407    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:17.892818 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:17.892777    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Oct 30 19:08:20.047607 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.047582    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:08:20.206694 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.206617    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr\" (UniqueName: \"kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr\") pod \"ae03b715-46cc-4133-bb34-402ef5688056\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") "
Oct 30 19:08:20.206694 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.206648    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls\") pod \"ae03b715-46cc-4133-bb34-402ef5688056\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") "
Oct 30 19:08:20.206694 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.206678    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location\") pod \"ae03b715-46cc-4133-bb34-402ef5688056\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") "
Oct 30 19:08:20.206970 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.206746    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config\") pod \"ae03b715-46cc-4133-bb34-402ef5688056\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") "
Oct 30 19:08:20.206970 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.206814    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert\") pod \"ae03b715-46cc-4133-bb34-402ef5688056\" (UID: \"ae03b715-46cc-4133-bb34-402ef5688056\") "
Oct 30 19:08:20.207121 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.207021    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location" pod "ae03b715-46cc-4133-bb34-402ef5688056" (UID: "ae03b715-46cc-4133-bb34-402ef5688056"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:08:20.207180 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.207125    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config" pod "ae03b715-46cc-4133-bb34-402ef5688056" (UID: "ae03b715-46cc-4133-bb34-402ef5688056"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:08:20.207534 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.207506    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert" pod "ae03b715-46cc-4133-bb34-402ef5688056" (UID: "ae03b715-46cc-4133-bb34-402ef5688056"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:08:20.208886 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.208863    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls" pod "ae03b715-46cc-4133-bb34-402ef5688056" (UID: "ae03b715-46cc-4133-bb34-402ef5688056"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:08:20.208989 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.208960    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr" pod "ae03b715-46cc-4133-bb34-402ef5688056" (UID: "ae03b715-46cc-4133-bb34-402ef5688056"). InnerVolumeSpecName "kube-api-access-5gbtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:08:20.307969 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.307943    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae03b715-46cc-4133-bb34-402ef5688056-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:20.307969 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.307964    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:20.307969 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.307974    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ae03b715-46cc-4133-bb34-402ef5688056-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:20.308155 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.307984    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gbtr\" (UniqueName: \"kubernetes.io/projected/ae03b715-46cc-4133-bb34-402ef5688056-kube-api-access-5gbtr\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:20.308155 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.307993    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae03b715-46cc-4133-bb34-402ef5688056-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:20.571694 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.571662    5652 generic.go:356] "Generic (PLEG): container finished" podID="ae03b715-46cc-4133-bb34-402ef5688056" containerID="d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca" exitCode=0
Oct 30 19:08:20.571850 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.571722    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"
Oct 30 19:08:20.571850 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.571730    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerDied","Data":"d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca"}
Oct 30 19:08:20.571850 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.571783    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" event={"ID":"ae03b715-46cc-4133-bb34-402ef5688056","Type":"ContainerDied","Data":"bb504dd641c7670bc2c8b8a4a67d946459bbad0ee80f5732d43df4b72ddf235b"}
Oct 30 19:08:20.571850 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.571812    5652 scope.go:122] "RemoveContainer" containerID="81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30"
Oct 30 19:08:20.580778 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.580762    5652 scope.go:122] "RemoveContainer" containerID="d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca"
Oct 30 19:08:20.587789 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.587769    5652 scope.go:122] "RemoveContainer" containerID="fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9"
Oct 30 19:08:20.594438 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.594421    5652 scope.go:122] "RemoveContainer" containerID="81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30"
Oct 30 19:08:20.594677 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:08:20.594660    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30\": container with ID starting with 81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30 not found: ID does not exist" containerID="81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30"
Oct 30 19:08:20.594726 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.594685    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30"} err="failed to get container status \"81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30\": rpc error: code = NotFound desc = could not find container \"81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30\": container with ID starting with 81dff45622dc57ddc223304e1c2a11348ce0d600c431790b2eb113916f760d30 not found: ID does not exist"
Oct 30 19:08:20.594726 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.594703    5652 scope.go:122] "RemoveContainer" containerID="d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca"
Oct 30 19:08:20.594940 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:08:20.594921    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca\": container with ID starting with d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca not found: ID does not exist" containerID="d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca"
Oct 30 19:08:20.595013 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.594949    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca"} err="failed to get container status \"d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca\": rpc error: code = NotFound desc = could not find container \"d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca\": container with ID starting with d5723e7c0652f3d0988b38b8c5535d17d910540323951ba6e45f414ac68596ca not found: ID does not exist"
Oct 30 19:08:20.595013 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.594971    5652 scope.go:122] "RemoveContainer" containerID="fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9"
Oct 30 19:08:20.595183 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:08:20.595167    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9\": container with ID starting with fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9 not found: ID does not exist" containerID="fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9"
Oct 30 19:08:20.595217 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.595186    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9"} err="failed to get container status \"fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9\": rpc error: code = NotFound desc = could not find container \"fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9\": container with ID starting with fe03dcce19242dff082c7c89e4a78acb556c5eef11e36076d1a7289bce4497b9 not found: ID does not exist"
Oct 30 19:08:20.743486 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.743459    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"]
Oct 30 19:08:20.793924 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:20.793899    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v"]
Oct 30 19:08:21.034099 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:21.034029    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/isvc-sklearn-scale-raw-3e8ba-predictor-785fb897cc-rkr7v" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: i/o timeout"
Oct 30 19:08:21.038553 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:21.038530    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae03b715-46cc-4133-bb34-402ef5688056" path="/var/lib/kubelet/pods/ae03b715-46cc-4133-bb34-402ef5688056/volumes"
Oct 30 19:08:26.433283 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:26.433243    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:36.433706 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:36.433671    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:38.084909 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:38.084877    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:08:40.820494 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:08:40.820417    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:08:46.433122 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:46.433085    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:51.037853 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:51.037810    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 19:08:57.401323 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:57.401289    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"]
Oct 30 19:08:57.401722 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:57.401511    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container" containerID="cri-o://07f89141116941be3b0b1eb22f85b242c26782db444bac27004e833a721c88a5" gracePeriod=30
Oct 30 19:08:57.401722 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:57.401572    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kube-rbac-proxy" containerID="cri-o://fdf79023f5b713c7c5fbe85f67b7c26f1753204b96d51f87bf94c32e0000b8e9" gracePeriod=30
Oct 30 19:08:57.402416 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:57.402397    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:08:57.702109 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:57.702036    5652 generic.go:356] "Generic (PLEG): container finished" podID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerID="fdf79023f5b713c7c5fbe85f67b7c26f1753204b96d51f87bf94c32e0000b8e9" exitCode=0
Oct 30 19:08:57.702109 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:08:57.702095    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerDied","Data":"fdf79023f5b713c7c5fbe85f67b7c26f1753204b96d51f87bf94c32e0000b8e9"}
Oct 30 19:09:01.428525 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.428479    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Oct 30 19:09:01.717722 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.717647    5652 generic.go:356] "Generic (PLEG): container finished" podID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerID="07f89141116941be3b0b1eb22f85b242c26782db444bac27004e833a721c88a5" exitCode=0
Oct 30 19:09:01.717722 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.717702    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerDied","Data":"07f89141116941be3b0b1eb22f85b242c26782db444bac27004e833a721c88a5"}
Oct 30 19:09:01.737060 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.737040    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:09:01.821833 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.821811    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert\") pod \"8d2d217a-8c76-4a2e-9d43-486d245d762b\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") "
Oct 30 19:09:01.821974 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.821882    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location\") pod \"8d2d217a-8c76-4a2e-9d43-486d245d762b\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") "
Oct 30 19:09:01.821974 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.821929    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls\") pod \"8d2d217a-8c76-4a2e-9d43-486d245d762b\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") "
Oct 30 19:09:01.821974 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.821954    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config\") pod \"8d2d217a-8c76-4a2e-9d43-486d245d762b\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") "
Oct 30 19:09:01.822148 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.821981    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb\" (UniqueName: \"kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb\") pod \"8d2d217a-8c76-4a2e-9d43-486d245d762b\" (UID: \"8d2d217a-8c76-4a2e-9d43-486d245d762b\") "
Oct 30 19:09:01.822280 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.822254    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert" pod "8d2d217a-8c76-4a2e-9d43-486d245d762b" (UID: "8d2d217a-8c76-4a2e-9d43-486d245d762b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:09:01.822280 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.822268    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location" pod "8d2d217a-8c76-4a2e-9d43-486d245d762b" (UID: "8d2d217a-8c76-4a2e-9d43-486d245d762b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:09:01.822400 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.822375    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config" pod "8d2d217a-8c76-4a2e-9d43-486d245d762b" (UID: "8d2d217a-8c76-4a2e-9d43-486d245d762b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:09:01.823960 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.823936    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls" pod "8d2d217a-8c76-4a2e-9d43-486d245d762b" (UID: "8d2d217a-8c76-4a2e-9d43-486d245d762b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:09:01.824052 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.823983    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb" pod "8d2d217a-8c76-4a2e-9d43-486d245d762b" (UID: "8d2d217a-8c76-4a2e-9d43-486d245d762b"). InnerVolumeSpecName "kube-api-access-mcvdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:09:01.923449 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.923426    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:09:01.923449 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.923449    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d2d217a-8c76-4a2e-9d43-486d245d762b-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:09:01.923616 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.923459    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d2d217a-8c76-4a2e-9d43-486d245d762b-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:09:01.923616 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.923468    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:09:01.923616 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:01.923477    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcvdb\" (UniqueName: \"kubernetes.io/projected/8d2d217a-8c76-4a2e-9d43-486d245d762b-kube-api-access-mcvdb\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:09:02.424442 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.424415    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:09:02.598379 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598347    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"]
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598632    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kube-rbac-proxy"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598642    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kube-rbac-proxy"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598664    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598669    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598679    5652 cpu_manager.go:414] "containerMap: removing container" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="storage-initializer"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598684    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="storage-initializer"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598691    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="storage-initializer"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598696    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="storage-initializer"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598703    5652 cpu_manager.go:414] "containerMap: removing container" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kube-rbac-proxy"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598708    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kube-rbac-proxy"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598719    5652 cpu_manager.go:414] "containerMap: removing container" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container"
Oct 30 19:09:02.598749 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598723    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container"
Oct 30 19:09:02.599142 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598766    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kserve-container"
Oct 30 19:09:02.599142 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598775    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kube-rbac-proxy"
Oct 30 19:09:02.599142 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598782    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae03b715-46cc-4133-bb34-402ef5688056" containerName="kserve-container"
Oct 30 19:09:02.599142 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.598789    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" containerName="kube-rbac-proxy"
Oct 30 19:09:02.602092 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.602077    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.659755 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.659727    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"]
Oct 30 19:09:02.660135 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.660119    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-e43a086b9d\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Oct 30 19:09:02.723104 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.723050    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"
Oct 30 19:09:02.723250 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.723006    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n" event={"ID":"8d2d217a-8c76-4a2e-9d43-486d245d762b","Type":"ContainerDied","Data":"aabbb23887d8091a9c936c7c30857f06d493b9645a54342551e62cfff34e84cf"}
Oct 30 19:09:02.723250 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.723200    5652 scope.go:122] "RemoveContainer" containerID="fdf79023f5b713c7c5fbe85f67b7c26f1753204b96d51f87bf94c32e0000b8e9"
Oct 30 19:09:02.729219 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.729198    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.729362 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.729344    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.729401 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.729371    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.729440 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.729397    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.729495 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.729438    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6gj\" (UniqueName: \"kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.732454 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.732438    5652 scope.go:122] "RemoveContainer" containerID="07f89141116941be3b0b1eb22f85b242c26782db444bac27004e833a721c88a5"
Oct 30 19:09:02.739282 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.739260    5652 scope.go:122] "RemoveContainer" containerID="20567354d38ad53aafa36972111b6586afc4d6dee1a7d64459a904a1c44553f8"
Oct 30 19:09:02.830549 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.830521    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.830689 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.830553    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.830689 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.830584    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.830689 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.830607    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6gj\" (UniqueName: \"kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.830689 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.830655    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.831086 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.831061    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.831183 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.831169    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.831311 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.831294    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.832878 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.832858    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.897874 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.897844    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6gj\" (UniqueName: \"kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj\") pod \"isvc-canary-promote-v2-predictor-9c55d877c-2qstm\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") " pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:02.899535 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.899512    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"]
Oct 30 19:09:02.906399 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.906378    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-predictor-659547d46-fnl2n"]
Oct 30 19:09:02.918838 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:02.918814    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:03.037349 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:03.037276    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d2d217a-8c76-4a2e-9d43-486d245d762b" path="/var/lib/kubelet/pods/8d2d217a-8c76-4a2e-9d43-486d245d762b/volumes"
Oct 30 19:09:03.338500 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:09:03.338472    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49552d6f_c9fd_469e_b0a3_accb7adaaf10.slice/crio-20c69fe628c68ce34429149c06362f12161e67ed3766f87c0ab9c6830186836f WatchSource:0}: Error finding container 20c69fe628c68ce34429149c06362f12161e67ed3766f87c0ab9c6830186836f: Status 404 returned error can't find the container with id 20c69fe628c68ce34429149c06362f12161e67ed3766f87c0ab9c6830186836f
Oct 30 19:09:03.339593 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:03.339560    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"]
Oct 30 19:09:03.728349 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:03.728253    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerStarted","Data":"2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb"}
Oct 30 19:09:03.728349 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:03.728323    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerStarted","Data":"20c69fe628c68ce34429149c06362f12161e67ed3766f87c0ab9c6830186836f"}
Oct 30 19:09:07.745930 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:07.745845    5652 generic.go:356] "Generic (PLEG): container finished" podID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerID="2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb" exitCode=0
Oct 30 19:09:07.745930 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:07.745918    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerDied","Data":"2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb"}
Oct 30 19:09:08.589268 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:08.589216    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:09:08.752343 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:08.752276    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerStarted","Data":"00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404"}
Oct 30 19:09:08.752343 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:08.752336    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerStarted","Data":"8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0"}
Oct 30 19:09:08.752752 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:08.752611    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:08.880454 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:08.880369    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podStartSLOduration=2.829322305 podStartE2EDuration="6.880354959s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.051032654s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:09:08.879113509 +0000 UTC m=+1837.959783906" watchObservedRunningTime="2026-10-30 19:09:08.880354959 +0000 UTC m=+1837.961025333"
Oct 30 19:09:09.756006 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:09.755974    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:09.757047 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:09.757015    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:09:10.759987 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:10.759940    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:09:10.821508 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:09:10.821473    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:09:15.764420 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:15.764387    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:09:15.764890 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:15.764861    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:09:25.765220 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:25.765178    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:09:35.765333 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:35.765283    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:09:38.468530 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:38.468493    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:09:40.821346 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:09:40.821310    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:09:45.765151 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:45.765114    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:09:55.765160 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:09:55.765116    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:10:05.765523 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:05.765483    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:10:10.820891 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:10:10.820802    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:10:15.765544 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:15.765495    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:10:21.035718 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:21.035673    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 19:10:23.051773 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:23.051741    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:10:27.971743 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:27.971707    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"]
Oct 30 19:10:27.972198 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:27.971937    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" containerID="cri-o://52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae" gracePeriod=30
Oct 30 19:10:28.022316 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:28.022291    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"]
Oct 30 19:10:28.022499 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:28.022468    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" containerID="cri-o://06df216bc249130fa2e7b1e5371117efa09bd6a3c2539df3a775e9c92350b749" gracePeriod=30
Oct 30 19:10:28.176658 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:28.176623    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:10:28.267575 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:28.267506    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:29.930424 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:29.930388    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:10:30.860300 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:30.860256    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:31.037882 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:31.037856    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:10:33.266892 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:33.266848    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:35.860376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:35.860338    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:38.266545 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:38.266499    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:38.266924 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:38.266601    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 19:10:38.746427 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:38.746399    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:10:40.821127 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:10:40.821090    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:10:40.861110 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:40.861080    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:40.861256 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:40.861170    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 19:10:43.267358 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:43.267313    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:43.374181 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:43.374153    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"]
Oct 30 19:10:43.374432 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:43.374395    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container" containerID="cri-o://8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0" gracePeriod=30
Oct 30 19:10:43.374505 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:43.374432    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kube-rbac-proxy" containerID="cri-o://00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404" gracePeriod=30
Oct 30 19:10:43.428806 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:43.428776    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:10:44.094683 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:44.094651    5652 generic.go:356] "Generic (PLEG): container finished" podID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerID="00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404" exitCode=0
Oct 30 19:10:44.094885 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:44.094716    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerDied","Data":"00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404"}
Oct 30 19:10:45.760642 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:45.760598    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Oct 30 19:10:45.860494 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:45.860451    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:47.411766 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.411736    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:10:47.515893 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.515825    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location\") pod \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") "
Oct 30 19:10:47.515893 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.515876    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config\") pod \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") "
Oct 30 19:10:47.515893 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.515894    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj\" (UniqueName: \"kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj\") pod \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") "
Oct 30 19:10:47.516179 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.515969    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert\") pod \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") "
Oct 30 19:10:47.516179 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.516004    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls\" (UniqueName: \"kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls\") pod \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\" (UID: \"49552d6f-c9fd-469e-b0a3-accb7adaaf10\") "
Oct 30 19:10:47.516303 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.516186    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location" pod "49552d6f-c9fd-469e-b0a3-accb7adaaf10" (UID: "49552d6f-c9fd-469e-b0a3-accb7adaaf10"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:10:47.516303 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.516256    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config" pod "49552d6f-c9fd-469e-b0a3-accb7adaaf10" (UID: "49552d6f-c9fd-469e-b0a3-accb7adaaf10"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:10:47.516372 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.516354    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert" pod "49552d6f-c9fd-469e-b0a3-accb7adaaf10" (UID: "49552d6f-c9fd-469e-b0a3-accb7adaaf10"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:10:47.518030 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.518001    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj" pod "49552d6f-c9fd-469e-b0a3-accb7adaaf10" (UID: "49552d6f-c9fd-469e-b0a3-accb7adaaf10"). InnerVolumeSpecName "kube-api-access-mb6gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:10:47.518135 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.518032    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls" pod "49552d6f-c9fd-469e-b0a3-accb7adaaf10" (UID: "49552d6f-c9fd-469e-b0a3-accb7adaaf10"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:10:47.616846 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.616815    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:47.616846 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.616841    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:47.616846 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.616851    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb6gj\" (UniqueName: \"kubernetes.io/projected/49552d6f-c9fd-469e-b0a3-accb7adaaf10-kube-api-access-mb6gj\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:47.617054 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.616862    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/49552d6f-c9fd-469e-b0a3-accb7adaaf10-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:47.617054 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:47.616871    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/49552d6f-c9fd-469e-b0a3-accb7adaaf10-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:48.110681 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.110649    5652 generic.go:356] "Generic (PLEG): container finished" podID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerID="8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0" exitCode=0
Oct 30 19:10:48.110856 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.110707    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"
Oct 30 19:10:48.110856 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.110738    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerDied","Data":"8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0"}
Oct 30 19:10:48.110856 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.110801    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm" event={"ID":"49552d6f-c9fd-469e-b0a3-accb7adaaf10","Type":"ContainerDied","Data":"20c69fe628c68ce34429149c06362f12161e67ed3766f87c0ab9c6830186836f"}
Oct 30 19:10:48.110856 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.110830    5652 scope.go:122] "RemoveContainer" containerID="00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404"
Oct 30 19:10:48.119881 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.119862    5652 scope.go:122] "RemoveContainer" containerID="8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0"
Oct 30 19:10:48.127173 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.127157    5652 scope.go:122] "RemoveContainer" containerID="2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb"
Oct 30 19:10:48.134086 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.134069    5652 scope.go:122] "RemoveContainer" containerID="00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404"
Oct 30 19:10:48.134429 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:10:48.134409    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404\": container with ID starting with 00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404 not found: ID does not exist" containerID="00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404"
Oct 30 19:10:48.134509 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.134436    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404"} err="failed to get container status \"00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404\": rpc error: code = NotFound desc = could not find container \"00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404\": container with ID starting with 00aa5fba6436576058f2a221477c402822423bc7ffc13bdc70faf9b79f444404 not found: ID does not exist"
Oct 30 19:10:48.134509 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.134454    5652 scope.go:122] "RemoveContainer" containerID="8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0"
Oct 30 19:10:48.134699 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:10:48.134682    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0\": container with ID starting with 8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0 not found: ID does not exist" containerID="8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0"
Oct 30 19:10:48.134740 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.134706    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0"} err="failed to get container status \"8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0\": rpc error: code = NotFound desc = could not find container \"8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0\": container with ID starting with 8b9fc6f5d03be142843c137ec19cd55ea1f00654ffd47945dac425c3f0bdd8e0 not found: ID does not exist"
Oct 30 19:10:48.134740 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.134722    5652 scope.go:122] "RemoveContainer" containerID="2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb"
Oct 30 19:10:48.134941 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:10:48.134925    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb\": container with ID starting with 2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb not found: ID does not exist" containerID="2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb"
Oct 30 19:10:48.134983 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.134944    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb"} err="failed to get container status \"2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb\": rpc error: code = NotFound desc = could not find container \"2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb\": container with ID starting with 2e9231a5468589b1dfc818569d0fb66382cc1c01e945be2d7c363621b6c0fbdb not found: ID does not exist"
Oct 30 19:10:48.266539 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.266512    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:48.333988 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.333968    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"]
Oct 30 19:10:48.340903 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:48.340883    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-e43a086b9d/isvc-canary-promote-v2-predictor-9c55d877c-2qstm"]
Oct 30 19:10:49.037637 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:49.037607    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" path="/var/lib/kubelet/pods/49552d6f-c9fd-469e-b0a3-accb7adaaf10/volumes"
Oct 30 19:10:50.860562 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:50.860527    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:53.267100 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:53.267054    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:55.860796 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:55.860761    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:10:58.109185 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.109161    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 19:10:58.147775 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.147745    5652 generic.go:356] "Generic (PLEG): container finished" podID="e0932751-3f89-4dc1-87de-1345dfcead80" containerID="06df216bc249130fa2e7b1e5371117efa09bd6a3c2539df3a775e9c92350b749" exitCode=0
Oct 30 19:10:58.147901 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.147815    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" event={"ID":"e0932751-3f89-4dc1-87de-1345dfcead80","Type":"ContainerDied","Data":"06df216bc249130fa2e7b1e5371117efa09bd6a3c2539df3a775e9c92350b749"}
Oct 30 19:10:58.147901 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.147873    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6" event={"ID":"e0932751-3f89-4dc1-87de-1345dfcead80","Type":"ContainerDied","Data":"8f10ca37ca63d6246cc62e93448cc98a046615612658023b6f50bb814884ba17"}
Oct 30 19:10:58.147901 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.147899    5652 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f10ca37ca63d6246cc62e93448cc98a046615612658023b6f50bb814884ba17"
Oct 30 19:10:58.149080 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.149060    5652 generic.go:356] "Generic (PLEG): container finished" podID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerID="52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae" exitCode=0
Oct 30 19:10:58.149158 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.149102    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" event={"ID":"f504ed08-afdf-46e2-8628-b520e52e92c1","Type":"ContainerDied","Data":"52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae"}
Oct 30 19:10:58.149158 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.149112    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"
Oct 30 19:10:58.149158 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.149143    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv" event={"ID":"f504ed08-afdf-46e2-8628-b520e52e92c1","Type":"ContainerDied","Data":"011f707665fbddd2af23177fd7e314189082aa47b6623424906e342fc1bd176b"}
Oct 30 19:10:58.149296 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.149165    5652 scope.go:122] "RemoveContainer" containerID="52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae"
Oct 30 19:10:58.157433 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.157419    5652 scope.go:122] "RemoveContainer" containerID="52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae"
Oct 30 19:10:58.157676 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:10:58.157655    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae\": container with ID starting with 52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae not found: ID does not exist" containerID="52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae"
Oct 30 19:10:58.157727 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.157686    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae"} err="failed to get container status \"52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae\": rpc error: code = NotFound desc = could not find container \"52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae\": container with ID starting with 52aafabc229cb2b913f91aeb0f415c8a99dd57f373f0ea6a83de6dcd4051a2ae not found: ID does not exist"
Oct 30 19:10:58.157971 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.157957    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 19:10:58.184890 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.184871    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle\") pod \"f504ed08-afdf-46e2-8628-b520e52e92c1\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") "
Oct 30 19:10:58.184986 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.184917    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls\") pod \"f504ed08-afdf-46e2-8628-b520e52e92c1\" (UID: \"f504ed08-afdf-46e2-8628-b520e52e92c1\") "
Oct 30 19:10:58.184986 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.184951    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle\") pod \"e0932751-3f89-4dc1-87de-1345dfcead80\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") "
Oct 30 19:10:58.185101 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.185020    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls\") pod \"e0932751-3f89-4dc1-87de-1345dfcead80\" (UID: \"e0932751-3f89-4dc1-87de-1345dfcead80\") "
Oct 30 19:10:58.185282 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.185258    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle" pod "f504ed08-afdf-46e2-8628-b520e52e92c1" (UID: "f504ed08-afdf-46e2-8628-b520e52e92c1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:10:58.185350 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.185314    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle" pod "e0932751-3f89-4dc1-87de-1345dfcead80" (UID: "e0932751-3f89-4dc1-87de-1345dfcead80"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:10:58.186823 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.186804    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls" pod "f504ed08-afdf-46e2-8628-b520e52e92c1" (UID: "f504ed08-afdf-46e2-8628-b520e52e92c1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:10:58.186871 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.186838    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls" pod "e0932751-3f89-4dc1-87de-1345dfcead80" (UID: "e0932751-3f89-4dc1-87de-1345dfcead80"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:10:58.285855 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.285795    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f504ed08-afdf-46e2-8628-b520e52e92c1-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:58.285855 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.285821    5652 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0932751-3f89-4dc1-87de-1345dfcead80-openshift-service-ca-bundle\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:58.285855 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.285832    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0932751-3f89-4dc1-87de-1345dfcead80-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:58.285855 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.285841    5652 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f504ed08-afdf-46e2-8628-b520e52e92c1-openshift-service-ca-bundle\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:10:58.575343 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.575311    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"]
Oct 30 19:10:58.580159 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:58.580140    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-bdcff-b79b8bbb6-lrhdv"]
Oct 30 19:10:59.037862 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:59.037834    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" path="/var/lib/kubelet/pods/f504ed08-afdf-46e2-8628-b520e52e92c1/volumes"
Oct 30 19:10:59.153368 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:59.153339    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"
Oct 30 19:10:59.323581 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:59.323553    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"]
Oct 30 19:10:59.374506 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:10:59.374484    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-1fd37956ac/model-chainer-raw-hpa-6d75d-84ff7585c-8z9j6"]
Oct 30 19:11:01.038144 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:01.038113    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" path="/var/lib/kubelet/pods/e0932751-3f89-4dc1-87de-1345dfcead80/volumes"
Oct 30 19:11:06.061641 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:06.061613    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:06.272588 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:06.272555    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:06.482284 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:06.482202    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:06.678385 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:06.678353    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:06.864156 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:06.864119    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:07.421152 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:07.421120    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:07.625050 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:07.625021    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:07.998394 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:07.998360    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:08.183835 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:08.183812    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:08.377453 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:08.377425    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:09.890395 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:09.890360    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:10.820142 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:11:10.820103    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:11:11.005388 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:11.005353    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:14.321156 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:14.321121    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:14.509175 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:14.509145    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:31.228761 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:31.228730    5652 scope.go:122] "RemoveContainer" containerID="06df216bc249130fa2e7b1e5371117efa09bd6a3c2539df3a775e9c92350b749"
Oct 30 19:11:35.272086 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:35.272055    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:35.483168 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:35.483136    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:39.119313 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:11:39.119281    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:11:40.820574 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:11:40.820497    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:12:10.820806 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:12:10.820763    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:12:20.056188 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:12:20.056152    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:12:39.408479 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:12:39.408449    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:12:40.820738 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:12:40.820705    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:12:54.613018 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:12:54.612985    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:12:56.783548 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:12:56.783512    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:03.855690 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:03.855656    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:04.103148 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:04.103114    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:04.366237 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:04.366189    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:04.578661 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:04.578637    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:07.845438 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:07.845400    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:08.114420 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.114332    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:08.318102 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318064    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"]
Oct 30 19:13:08.318366 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318352    5652 cpu_manager.go:414] "containerMap: removing container" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d"
Oct 30 19:13:08.318366 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318366    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318381    5652 cpu_manager.go:414] "containerMap: removing container" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kube-rbac-proxy"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318386    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kube-rbac-proxy"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318400    5652 cpu_manager.go:414] "containerMap: removing container" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318406    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318418    5652 cpu_manager.go:414] "containerMap: removing container" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="storage-initializer"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318423    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="storage-initializer"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318430    5652 cpu_manager.go:414] "containerMap: removing container" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container"
Oct 30 19:13:08.318474 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318435    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container"
Oct 30 19:13:08.318714 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318484    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0932751-3f89-4dc1-87de-1345dfcead80" containerName="model-chainer-raw-hpa-6d75d"
Oct 30 19:13:08.318714 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318493    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kube-rbac-proxy"
Oct 30 19:13:08.318714 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318500    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="f504ed08-afdf-46e2-8628-b520e52e92c1" containerName="model-chainer-raw-bdcff"
Oct 30 19:13:08.318714 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.318506    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="49552d6f-c9fd-469e-b0a3-accb7adaaf10" containerName="kserve-container"
Oct 30 19:13:08.321370 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.321347    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.420545 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.420493    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"kube-root-ca.crt\""
Oct 30 19:13:08.420646 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.420572    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"message-dumper-raw-cipn-kube-rbac-proxy-sar-config\""
Oct 30 19:13:08.420646 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.420615    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"message-dumper-raw-cipn-predictor-serving-cert\""
Oct 30 19:13:08.420646 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.420612    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"openshift-service-ca.crt\""
Oct 30 19:13:08.420741 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.420651    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"default-dockercfg-4ft87\""
Oct 30 19:13:08.426847 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.426826    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.426900 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.426867    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.426994 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.426979    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpbxn\" (UniqueName: \"kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.431542 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.431514    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"]
Oct 30 19:13:08.527737 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.527715    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpbxn\" (UniqueName: \"kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.527861 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.527759    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.527861 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.527791    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.528414 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.528391    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.530084 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.530066    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.592860 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.592834    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpbxn\" (UniqueName: \"kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn\") pod \"message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") " pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:08.635477 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:08.635452    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:09.011698 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:09.011617    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"]
Oct 30 19:13:09.014525 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:13:09.014492    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f753845_f524_44a4_bd29_42703db5b79a.slice/crio-4df4611644831b0cb93731e10cc3306033ec39646d03e45be12bdbe4e8583f18 WatchSource:0}: Error finding container 4df4611644831b0cb93731e10cc3306033ec39646d03e45be12bdbe4e8583f18: Status 404 returned error can't find the container with id 4df4611644831b0cb93731e10cc3306033ec39646d03e45be12bdbe4e8583f18
Oct 30 19:13:09.612973 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:09.612942    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" event={"ID":"4f753845-f524-44a4-bd29-42703db5b79a","Type":"ContainerStarted","Data":"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"}
Oct 30 19:13:09.613145 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:09.612999    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" event={"ID":"4f753845-f524-44a4-bd29-42703db5b79a","Type":"ContainerStarted","Data":"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"}
Oct 30 19:13:09.613145 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:09.613023    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" event={"ID":"4f753845-f524-44a4-bd29-42703db5b79a","Type":"ContainerStarted","Data":"4df4611644831b0cb93731e10cc3306033ec39646d03e45be12bdbe4e8583f18"}
Oct 30 19:13:09.613145 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:09.613076    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:09.727913 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:09.727868    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" podStartSLOduration=1.7278557879999998 podStartE2EDuration="1.727855788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:13:09.727198194 +0000 UTC m=+2078.807868570" watchObservedRunningTime="2026-10-30 19:13:09.727855788 +0000 UTC m=+2078.808526163"
Oct 30 19:13:10.616856 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:10.616829    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:10.618400 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:10.618378    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:10.821277 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:13:10.821205    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:13:17.628976 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:17.628943    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:13:28.121437 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.121404    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:28.419491 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.419384    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:28.738605 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.738527    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"]
Oct 30 19:13:28.745462 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.745438    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.798162 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.798134    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"isvc-logger-raw-cipn-predictor-serving-cert\""
Oct 30 19:13:28.798162 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.798140    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"seaweedfs-s3-creds\""
Oct 30 19:13:28.844685 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.844661    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:13:28.844685 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.844675    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-e3ef70bc02\"/\"isvc-logger-raw-cipn-kube-rbac-proxy-sar-config\""
Oct 30 19:13:28.845514 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.845496    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"]
Oct 30 19:13:28.876107 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.876084    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.876215 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.876114    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.876215 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.876136    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.876319 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.876286    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgt84\" (UniqueName: \"kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.876357 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.876329    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.977457 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.977432    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.977568 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.977473    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.977568 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.977501    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.977568 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.977533    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.977731 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.977590    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgt84\" (UniqueName: \"kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.977983 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.977964    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.978178 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.978159    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.978393 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.978376    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:28.979952 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:28.979932    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:29.037262 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:29.037196    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgt84\" (UniqueName: \"kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84\") pod \"isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") " pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:29.063496 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:29.063474    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:29.538214 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:29.538179    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"]
Oct 30 19:13:29.591069 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:13:29.591040    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da0dfca_6459_40c7_a8f0_3a003df7e052.slice/crio-f062b4c6f86a55dfee8a6c361300d192aea3f191daf6cf6fd72ad38fe40d5acc WatchSource:0}: Error finding container f062b4c6f86a55dfee8a6c361300d192aea3f191daf6cf6fd72ad38fe40d5acc: Status 404 returned error can't find the container with id f062b4c6f86a55dfee8a6c361300d192aea3f191daf6cf6fd72ad38fe40d5acc
Oct 30 19:13:29.684532 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:29.684492    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerStarted","Data":"63eac3b9d26de6a82901fd408b1937c579b5869e35f116b36c5a0e4731d420b4"}
Oct 30 19:13:29.684638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:29.684588    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerStarted","Data":"f062b4c6f86a55dfee8a6c361300d192aea3f191daf6cf6fd72ad38fe40d5acc"}
Oct 30 19:13:33.700552 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:33.700464    5652 generic.go:356] "Generic (PLEG): container finished" podID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerID="63eac3b9d26de6a82901fd408b1937c579b5869e35f116b36c5a0e4731d420b4" exitCode=0
Oct 30 19:13:33.701003 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:33.700540    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerDied","Data":"63eac3b9d26de6a82901fd408b1937c579b5869e35f116b36c5a0e4731d420b4"}
Oct 30 19:13:34.705998 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.705961    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerStarted","Data":"655a6caa716304098ef13bca92e0d6bba822e0b41e98bab87da013d1dc40b55b"}
Oct 30 19:13:34.706498 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.706043    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerStarted","Data":"4ca69d6faa56f53f3c15a4139ec9de98a6a41482f8bc2dcce699482231e7ecff"}
Oct 30 19:13:34.706498 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.706084    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerStarted","Data":"9bae2c8387c31dead38273f9e0a2ecd641360b29260490f3b13a166c275ee75d"}
Oct 30 19:13:34.706498 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.706478    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:34.706669 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.706525    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:34.706669 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.706550    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:34.707638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.707615    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:13:34.708243 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.708209    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:13:34.894573 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:34.894523    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podStartSLOduration=3.173787759 podStartE2EDuration="6.894510415s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.720722656s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:13:34.877220022 +0000 UTC m=+2103.957890395" watchObservedRunningTime="2026-10-30 19:13:34.894510415 +0000 UTC m=+2103.975180788"
Oct 30 19:13:35.710166 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:35.710124    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:13:35.710679 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:35.710656    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:13:39.745203 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:39.745168    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:13:40.714619 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:40.714590    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:13:40.715257 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:40.715208    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:13:40.715533 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:40.715503    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:13:40.820451 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:13:40.820418    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:13:50.715935 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:50.715888    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:13:50.716417 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:13:50.716394    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:14:00.715299 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:00.715252    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:14:00.715837 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:00.715733    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:14:10.715155 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:10.715111    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:14:10.715666 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:10.715643    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:14:10.820755 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:14:10.820691    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:14:20.715108 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:20.715056    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:14:20.715598 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:20.715528    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:14:30.715351 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:30.715304    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:14:30.715828 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:30.715787    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:14:40.150375 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:40.150337    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:14:40.715889 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:40.715814    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:14:40.716293 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:40.716267    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:14:40.821004 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:14:40.820971    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:14:50.716301 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:50.716272    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:14:50.716733 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:14:50.716362    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:15:02.928314 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:02.928285    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-e3ef70bc02_message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b_4f753845-f524-44a4-bd29-42703db5b79a/kserve-container/0.log"
Oct 30 19:15:02.950897 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:02.950837    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:04.008580 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.008547    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:04.615603 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.615568    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"]
Oct 30 19:15:04.615905 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.615875    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" containerID="cri-o://9bae2c8387c31dead38273f9e0a2ecd641360b29260490f3b13a166c275ee75d" gracePeriod=30
Oct 30 19:15:04.616047 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.615925    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" containerID="cri-o://4ca69d6faa56f53f3c15a4139ec9de98a6a41482f8bc2dcce699482231e7ecff" gracePeriod=30
Oct 30 19:15:04.616047 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.615875    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" containerID="cri-o://655a6caa716304098ef13bca92e0d6bba822e0b41e98bab87da013d1dc40b55b" gracePeriod=30
Oct 30 19:15:04.679978 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.679957    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:04.935676 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.935597    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"]
Oct 30 19:15:04.935845 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.935820    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kserve-container" containerID="cri-o://c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538" gracePeriod=30
Oct 30 19:15:04.935888 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:04.935854    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kube-rbac-proxy" containerID="cri-o://6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8" gracePeriod=30
Oct 30 19:15:05.021412 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.021387    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:05.034482 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.034456    5652 generic.go:356] "Generic (PLEG): container finished" podID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerID="4ca69d6faa56f53f3c15a4139ec9de98a6a41482f8bc2dcce699482231e7ecff" exitCode=0
Oct 30 19:15:05.036880 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.036858    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerDied","Data":"4ca69d6faa56f53f3c15a4139ec9de98a6a41482f8bc2dcce699482231e7ecff"}
Oct 30 19:15:05.171435 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.171409    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:15:05.205685 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.205631    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn\" (UniqueName: \"kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn\") pod \"4f753845-f524-44a4-bd29-42703db5b79a\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") "
Oct 30 19:15:05.205785 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.205700    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls\") pod \"4f753845-f524-44a4-bd29-42703db5b79a\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") "
Oct 30 19:15:05.205785 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.205770    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config\") pod \"4f753845-f524-44a4-bd29-42703db5b79a\" (UID: \"4f753845-f524-44a4-bd29-42703db5b79a\") "
Oct 30 19:15:05.206106 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.206080    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config" pod "4f753845-f524-44a4-bd29-42703db5b79a" (UID: "4f753845-f524-44a4-bd29-42703db5b79a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:15:05.207591 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.207570    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn" pod "4f753845-f524-44a4-bd29-42703db5b79a" (UID: "4f753845-f524-44a4-bd29-42703db5b79a"). InnerVolumeSpecName "kube-api-access-zpbxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:15:05.207669 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.207647    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls" pod "4f753845-f524-44a4-bd29-42703db5b79a" (UID: "4f753845-f524-44a4-bd29-42703db5b79a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:15:05.306509 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.306475    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4f753845-f524-44a4-bd29-42703db5b79a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:05.306509 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.306501    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpbxn\" (UniqueName: \"kubernetes.io/projected/4f753845-f524-44a4-bd29-42703db5b79a-kube-api-access-zpbxn\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:05.306660 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.306515    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f753845-f524-44a4-bd29-42703db5b79a-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:05.710533 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:05.710491    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Oct 30 19:15:06.039526 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039441    5652 generic.go:356] "Generic (PLEG): container finished" podID="4f753845-f524-44a4-bd29-42703db5b79a" containerID="6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8" exitCode=0
Oct 30 19:15:06.039526 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039467    5652 generic.go:356] "Generic (PLEG): container finished" podID="4f753845-f524-44a4-bd29-42703db5b79a" containerID="c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538" exitCode=2
Oct 30 19:15:06.039526 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039493    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"
Oct 30 19:15:06.040024 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039528    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" event={"ID":"4f753845-f524-44a4-bd29-42703db5b79a","Type":"ContainerDied","Data":"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"}
Oct 30 19:15:06.040024 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039587    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" event={"ID":"4f753845-f524-44a4-bd29-42703db5b79a","Type":"ContainerDied","Data":"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"}
Oct 30 19:15:06.040024 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039609    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b" event={"ID":"4f753845-f524-44a4-bd29-42703db5b79a","Type":"ContainerDied","Data":"4df4611644831b0cb93731e10cc3306033ec39646d03e45be12bdbe4e8583f18"}
Oct 30 19:15:06.040024 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.039633    5652 scope.go:122] "RemoveContainer" containerID="6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"
Oct 30 19:15:06.047593 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.047577    5652 scope.go:122] "RemoveContainer" containerID="c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"
Oct 30 19:15:06.054563 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.054548    5652 scope.go:122] "RemoveContainer" containerID="6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"
Oct 30 19:15:06.054801 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:15:06.054782    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8\": container with ID starting with 6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8 not found: ID does not exist" containerID="6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"
Oct 30 19:15:06.054841 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.054811    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"} err="failed to get container status \"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8\": rpc error: code = NotFound desc = could not find container \"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8\": container with ID starting with 6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8 not found: ID does not exist"
Oct 30 19:15:06.054841 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.054827    5652 scope.go:122] "RemoveContainer" containerID="c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"
Oct 30 19:15:06.055039 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:15:06.055026    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538\": container with ID starting with c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538 not found: ID does not exist" containerID="c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"
Oct 30 19:15:06.055075 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.055043    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"} err="failed to get container status \"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538\": rpc error: code = NotFound desc = could not find container \"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538\": container with ID starting with c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538 not found: ID does not exist"
Oct 30 19:15:06.055075 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.055054    5652 scope.go:122] "RemoveContainer" containerID="6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"
Oct 30 19:15:06.055274 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.055254    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8"} err="failed to get container status \"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8\": rpc error: code = NotFound desc = could not find container \"6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8\": container with ID starting with 6187bd444165c473605e815ee411fd7bc29704b8004800c106155285bc684ec8 not found: ID does not exist"
Oct 30 19:15:06.055315 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.055277    5652 scope.go:122] "RemoveContainer" containerID="c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"
Oct 30 19:15:06.055497 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.055482    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538"} err="failed to get container status \"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538\": rpc error: code = NotFound desc = could not find container \"c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538\": container with ID starting with c313ed139a47f257add9863a870ac04e73a873caa98a1281886b62dd6b1db538 not found: ID does not exist"
Oct 30 19:15:06.197772 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.197749    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"]
Oct 30 19:15:06.244410 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:06.244388    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-e3ef70bc02/message-dumper-raw-cipn-predictor-7bfbfbb5f-q757b"]
Oct 30 19:15:07.038102 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:07.038061    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f753845-f524-44a4-bd29-42703db5b79a" path="/var/lib/kubelet/pods/4f753845-f524-44a4-bd29-42703db5b79a/volumes"
Oct 30 19:15:09.054272 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:09.054244    5652 generic.go:356] "Generic (PLEG): container finished" podID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerID="9bae2c8387c31dead38273f9e0a2ecd641360b29260490f3b13a166c275ee75d" exitCode=0
Oct 30 19:15:09.054272 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:09.054261    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerDied","Data":"9bae2c8387c31dead38273f9e0a2ecd641360b29260490f3b13a166c275ee75d"}
Oct 30 19:15:10.711003 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:10.710959    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Oct 30 19:15:10.715333 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:10.715302    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:15:10.715711 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:10.715686    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:15:10.820816 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:15:10.820784    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:15:15.710624 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:15.710582    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Oct 30 19:15:15.711092 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:15.710727    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:15:20.710668 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:20.710626    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Oct 30 19:15:20.716003 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:20.715970    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:15:20.716412 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:20.716389    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:15:25.710591 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:25.710542    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Oct 30 19:15:30.710358 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:30.710308    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Oct 30 19:15:30.715772 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:30.715743    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Oct 30 19:15:30.715916 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:30.715883    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:15:30.716110 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:30.716084    5652 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:15:30.716217 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:30.716206    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:15:35.146044 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.144523    5652 generic.go:356] "Generic (PLEG): container finished" podID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerID="655a6caa716304098ef13bca92e0d6bba822e0b41e98bab87da013d1dc40b55b" exitCode=0
Oct 30 19:15:35.146044 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.144679    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerDied","Data":"655a6caa716304098ef13bca92e0d6bba822e0b41e98bab87da013d1dc40b55b"}
Oct 30 19:15:35.254919 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.254898    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:15:35.325394 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.325361    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84\" (UniqueName: \"kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84\") pod \"8da0dfca-6459-40c7-a8f0-3a003df7e052\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") "
Oct 30 19:15:35.325518 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.325461    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location\") pod \"8da0dfca-6459-40c7-a8f0-3a003df7e052\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") "
Oct 30 19:15:35.325518 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.325507    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls\" (UniqueName: \"kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls\") pod \"8da0dfca-6459-40c7-a8f0-3a003df7e052\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") "
Oct 30 19:15:35.325630 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.325534    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert\") pod \"8da0dfca-6459-40c7-a8f0-3a003df7e052\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") "
Oct 30 19:15:35.325630 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.325596    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config\") pod \"8da0dfca-6459-40c7-a8f0-3a003df7e052\" (UID: \"8da0dfca-6459-40c7-a8f0-3a003df7e052\") "
Oct 30 19:15:35.326143 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.326100    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location" pod "8da0dfca-6459-40c7-a8f0-3a003df7e052" (UID: "8da0dfca-6459-40c7-a8f0-3a003df7e052"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:15:35.326304 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.326249    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config" pod "8da0dfca-6459-40c7-a8f0-3a003df7e052" (UID: "8da0dfca-6459-40c7-a8f0-3a003df7e052"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:15:35.326608 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.326562    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert" pod "8da0dfca-6459-40c7-a8f0-3a003df7e052" (UID: "8da0dfca-6459-40c7-a8f0-3a003df7e052"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:15:35.326708 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.326658    5652 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:35.326708 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.326691    5652 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8da0dfca-6459-40c7-a8f0-3a003df7e052-kserve-provision-location\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:35.332753 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.330881    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls" pod "8da0dfca-6459-40c7-a8f0-3a003df7e052" (UID: "8da0dfca-6459-40c7-a8f0-3a003df7e052"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:15:35.333452 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.333256    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84" pod "8da0dfca-6459-40c7-a8f0-3a003df7e052" (UID: "8da0dfca-6459-40c7-a8f0-3a003df7e052"). InnerVolumeSpecName "kube-api-access-kgt84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:15:35.427075 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.427026    5652 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8da0dfca-6459-40c7-a8f0-3a003df7e052-proxy-tls\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:35.427075 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.427046    5652 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8da0dfca-6459-40c7-a8f0-3a003df7e052-cabundle-cert\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:35.427075 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:35.427057    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgt84\" (UniqueName: \"kubernetes.io/projected/8da0dfca-6459-40c7-a8f0-3a003df7e052-kube-api-access-kgt84\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:15:36.150063 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.150027    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8" event={"ID":"8da0dfca-6459-40c7-a8f0-3a003df7e052","Type":"ContainerDied","Data":"f062b4c6f86a55dfee8a6c361300d192aea3f191daf6cf6fd72ad38fe40d5acc"}
Oct 30 19:15:36.150476 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.150090    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"
Oct 30 19:15:36.150476 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.150116    5652 scope.go:122] "RemoveContainer" containerID="655a6caa716304098ef13bca92e0d6bba822e0b41e98bab87da013d1dc40b55b"
Oct 30 19:15:36.158308 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.158245    5652 scope.go:122] "RemoveContainer" containerID="4ca69d6faa56f53f3c15a4139ec9de98a6a41482f8bc2dcce699482231e7ecff"
Oct 30 19:15:36.165760 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.165744    5652 scope.go:122] "RemoveContainer" containerID="9bae2c8387c31dead38273f9e0a2ecd641360b29260490f3b13a166c275ee75d"
Oct 30 19:15:36.172954 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.172935    5652 scope.go:122] "RemoveContainer" containerID="63eac3b9d26de6a82901fd408b1937c579b5869e35f116b36c5a0e4731d420b4"
Oct 30 19:15:36.357350 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.357321    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"]
Oct 30 19:15:36.404016 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:36.403951    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-e3ef70bc02/isvc-logger-raw-cipn-predictor-d8d6b9d48-hrhq8"]
Oct 30 19:15:37.037095 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:37.037069    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" path="/var/lib/kubelet/pods/8da0dfca-6459-40c7-a8f0-3a003df7e052/volumes"
Oct 30 19:15:38.162214 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:38.162182    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:39.896260 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896205    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9lr6s/must-gather-2gcwp"]
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896492    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896504    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896514    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896520    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896527    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896532    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896546    5652 cpu_manager.go:414] "containerMap: removing container" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="storage-initializer"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896552    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="storage-initializer"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896562    5652 cpu_manager.go:414] "containerMap: removing container" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kserve-container"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896567    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kserve-container"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896583    5652 cpu_manager.go:414] "containerMap: removing container" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kube-rbac-proxy"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896587    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kube-rbac-proxy"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896629    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="agent"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896637    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kserve-container"
Oct 30 19:15:39.896638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896643    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="8da0dfca-6459-40c7-a8f0-3a003df7e052" containerName="kube-rbac-proxy"
Oct 30 19:15:39.897066 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896653    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kserve-container"
Oct 30 19:15:39.897066 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.896660    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f753845-f524-44a4-bd29-42703db5b79a" containerName="kube-rbac-proxy"
Oct 30 19:15:39.900958 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.900941    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:39.932462 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.932438    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:39.955463 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:39.955436    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lr6s/must-gather-2gcwp"]
Oct 30 19:15:40.001081 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.001059    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9lr6s\"/\"openshift-service-ca.crt\""
Oct 30 19:15:40.001198 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.001098    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9lr6s\"/\"kube-root-ca.crt\""
Oct 30 19:15:40.001350 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.001332    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9lr6s\"/\"default-dockercfg-pl4lx\""
Oct 30 19:15:40.060942 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.060919    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtpm\" (UniqueName: \"kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm\") pod \"must-gather-2gcwp\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") " pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.061032 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.060968    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output\") pod \"must-gather-2gcwp\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") " pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.128638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.128616    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:40.161759 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.161710    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output\") pod \"must-gather-2gcwp\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") " pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.161759 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.161754    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtpm\" (UniqueName: \"kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm\") pod \"must-gather-2gcwp\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") " pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.162045 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.162026    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output\") pod \"must-gather-2gcwp\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") " pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.222811 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.222786    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtpm\" (UniqueName: \"kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm\") pod \"must-gather-2gcwp\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") " pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.231027 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.231008    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:15:40.439589 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.439510    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:40.595283 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.595253    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lr6s/must-gather-2gcwp"]
Oct 30 19:15:40.598240 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:15:40.598197    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5717231c_c038_4fd3_8fb3_33231f014710.slice/crio-340728370c00863ebc083c43c2df2d34b5ab1b78c081a66ebb76c9e719fe3b07 WatchSource:0}: Error finding container 340728370c00863ebc083c43c2df2d34b5ab1b78c081a66ebb76c9e719fe3b07: Status 404 returned error can't find the container with id 340728370c00863ebc083c43c2df2d34b5ab1b78c081a66ebb76c9e719fe3b07
Oct 30 19:15:40.600008 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:40.599990    5652 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:15:40.820394 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:15:40.820367    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:15:41.171420 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:41.171340    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lr6s/must-gather-2gcwp" event={"ID":"5717231c-c038-4fd3-8fb3-33231f014710","Type":"ContainerStarted","Data":"340728370c00863ebc083c43c2df2d34b5ab1b78c081a66ebb76c9e719fe3b07"}
Oct 30 19:15:45.776757 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:45.776717    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:45.982614 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:45.982570    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:15:48.199709 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:48.199670    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lr6s/must-gather-2gcwp" event={"ID":"5717231c-c038-4fd3-8fb3-33231f014710","Type":"ContainerStarted","Data":"05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569"}
Oct 30 19:15:48.200113 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:48.199722    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lr6s/must-gather-2gcwp" event={"ID":"5717231c-c038-4fd3-8fb3-33231f014710","Type":"ContainerStarted","Data":"c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"}
Oct 30 19:15:48.311376 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:15:48.311324    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-9lr6s/must-gather-2gcwp" podStartSLOduration=2.578840264 podStartE2EDuration="9.311310319s" totalImagesPullingTime="6.732470055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:15:48.31073088 +0000 UTC m=+2237.391401255" watchObservedRunningTime="2026-10-30 19:15:48.311310319 +0000 UTC m=+2237.391980692"
Oct 30 19:16:10.820145 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:16:10.820070    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:16:40.775062 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:16:40.775024    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:16:40.820180 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:16:40.820145    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:17:03.023502 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:17:03.023468    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:17:04.392805 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:17:04.392773    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:17:10.821008 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:17:10.820976    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:17:30.382942 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:17:30.382889    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:17:31.377082 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:17:31.377050    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:17:40.819855 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:17:40.819771    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:17:41.094209 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:17:41.094130    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:18:10.821632 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:18:10.821597    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:18:40.820357 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:18:40.820324    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:18:41.492595 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:18:41.492562    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:10.820631 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:10.820549    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:19:40.820273 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:40.820220    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:19:41.812721 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:41.812687    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:44.021334 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:44.021300    5652 generic.go:356] "Generic (PLEG): container finished" podID="5717231c-c038-4fd3-8fb3-33231f014710" containerID="c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed" exitCode=0
Oct 30 19:19:44.021748 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:44.021376    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lr6s/must-gather-2gcwp" event={"ID":"5717231c-c038-4fd3-8fb3-33231f014710","Type":"ContainerDied","Data":"c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"}
Oct 30 19:19:44.021748 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:44.021682    5652 scope.go:122] "RemoveContainer" containerID="c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"
Oct 30 19:19:44.301377 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:44.301302    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9lr6s_must-gather-2gcwp_5717231c-c038-4fd3-8fb3-33231f014710/gather/0.log"
Oct 30 19:19:45.716171 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:45.716133    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:46.011317 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.011248    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-24xkm/must-gather-m28bf"]
Oct 30 19:19:46.013745 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.013730    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.062859 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.062827    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:46.066394 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.066372    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-24xkm\"/\"kube-root-ca.crt\""
Oct 30 19:19:46.079722 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.079700    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/226b50cf-7b58-44b4-8693-2af4d88aa65b-must-gather-output\") pod \"must-gather-m28bf\" (UID: \"226b50cf-7b58-44b4-8693-2af4d88aa65b\") " pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.079799 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.079730    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zts8g\" (UniqueName: \"kubernetes.io/projected/226b50cf-7b58-44b4-8693-2af4d88aa65b-kube-api-access-zts8g\") pod \"must-gather-m28bf\" (UID: \"226b50cf-7b58-44b4-8693-2af4d88aa65b\") " pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.111720 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.111699    5652 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-24xkm\"/\"openshift-service-ca.crt\""
Oct 30 19:19:46.111926 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.111907    5652 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-24xkm\"/\"default-dockercfg-2tdsl\""
Oct 30 19:19:46.112458 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.112442    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-24xkm/must-gather-m28bf"]
Oct 30 19:19:46.180336 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.180317    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/226b50cf-7b58-44b4-8693-2af4d88aa65b-must-gather-output\") pod \"must-gather-m28bf\" (UID: \"226b50cf-7b58-44b4-8693-2af4d88aa65b\") " pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.180432 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.180343    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zts8g\" (UniqueName: \"kubernetes.io/projected/226b50cf-7b58-44b4-8693-2af4d88aa65b-kube-api-access-zts8g\") pod \"must-gather-m28bf\" (UID: \"226b50cf-7b58-44b4-8693-2af4d88aa65b\") " pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.180645 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.180630    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/226b50cf-7b58-44b4-8693-2af4d88aa65b-must-gather-output\") pod \"must-gather-m28bf\" (UID: \"226b50cf-7b58-44b4-8693-2af4d88aa65b\") " pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.240062 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.240038    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zts8g\" (UniqueName: \"kubernetes.io/projected/226b50cf-7b58-44b4-8693-2af4d88aa65b-kube-api-access-zts8g\") pod \"must-gather-m28bf\" (UID: \"226b50cf-7b58-44b4-8693-2af4d88aa65b\") " pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.291536 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.291484    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:46.325541 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.325522    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-24xkm/must-gather-m28bf"
Oct 30 19:19:46.689421 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:46.689387    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-24xkm/must-gather-m28bf"]
Oct 30 19:19:46.692383 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:19:46.692357    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod226b50cf_7b58_44b4_8693_2af4d88aa65b.slice/crio-ee4ad47fa143057aaea8b2f951fdeef9aa85bdc00f2df7ef472174e3c45bb754 WatchSource:0}: Error finding container ee4ad47fa143057aaea8b2f951fdeef9aa85bdc00f2df7ef472174e3c45bb754: Status 404 returned error can't find the container with id ee4ad47fa143057aaea8b2f951fdeef9aa85bdc00f2df7ef472174e3c45bb754
Oct 30 19:19:47.036637 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:47.036569    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-24xkm/must-gather-m28bf" event={"ID":"226b50cf-7b58-44b4-8693-2af4d88aa65b","Type":"ContainerStarted","Data":"ee4ad47fa143057aaea8b2f951fdeef9aa85bdc00f2df7ef472174e3c45bb754"}
Oct 30 19:19:48.038615 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:48.038593    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-24xkm/must-gather-m28bf" event={"ID":"226b50cf-7b58-44b4-8693-2af4d88aa65b","Type":"ContainerStarted","Data":"e7d22ad6223066b1595a53ede2b47c4f07a0f1b54a3ca85dfdde6e8758b8446b"}
Oct 30 19:19:49.043590 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:49.043559    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-24xkm/must-gather-m28bf" event={"ID":"226b50cf-7b58-44b4-8693-2af4d88aa65b","Type":"ContainerStarted","Data":"0145fbf784cbceb698bfb3f3580e2c20384b94bc98e1f5a46893aa1616ccf0e7"}
Oct 30 19:19:50.677056 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:50.676998    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-24xkm/must-gather-m28bf" podStartSLOduration=4.443545931 podStartE2EDuration="5.676982622s" totalImagesPullingTime="1.233436691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:19:49.165495329 +0000 UTC m=+2478.246165702" watchObservedRunningTime="2026-10-30 19:19:50.676982622 +0000 UTC m=+2479.757652995"
Oct 30 19:19:50.677547 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:50.677339    5652 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-9lr6s/must-gather-2gcwp"]
Oct 30 19:19:50.677547 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:50.677503    5652 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-must-gather-9lr6s/must-gather-2gcwp" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="copy" containerID="cri-o://05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569" gracePeriod=2
Oct 30 19:19:50.724209 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:50.724145    5652 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-9lr6s/must-gather-2gcwp"]
Oct 30 19:19:50.725426 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:50.725393    5652 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-2gcwp\" is forbidden: User \"system:node:ip-10-0-133-244.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9lr6s\": no relationship found between node 'ip-10-0-133-244.us-west-2.compute.internal' and this object" podUID="5717231c-c038-4fd3-8fb3-33231f014710" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:19:50.952368 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:50.952347    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9lr6s_must-gather-2gcwp_5717231c-c038-4fd3-8fb3-33231f014710/copy/0.log"
Oct 30 19:19:50.954938 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:50.954921    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:19:51.002977 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:51.002944    5652 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-2gcwp\" is forbidden: User \"system:node:ip-10-0-133-244.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9lr6s\": no relationship found between node 'ip-10-0-133-244.us-west-2.compute.internal' and this object" podUID="5717231c-c038-4fd3-8fb3-33231f014710" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:19:51.051979 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.051959    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9lr6s_must-gather-2gcwp_5717231c-c038-4fd3-8fb3-33231f014710/copy/0.log"
Oct 30 19:19:51.052335 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.052313    5652 generic.go:356] "Generic (PLEG): container finished" podID="5717231c-c038-4fd3-8fb3-33231f014710" containerID="05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569" exitCode=143
Oct 30 19:19:51.052436 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.052354    5652 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:19:51.052436 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.052394    5652 scope.go:122] "RemoveContainer" containerID="05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569"
Oct 30 19:19:51.059601 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.059583    5652 scope.go:122] "RemoveContainer" containerID="c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"
Oct 30 19:19:51.071814 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.071797    5652 scope.go:122] "RemoveContainer" containerID="05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569"
Oct 30 19:19:51.072067 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:51.072050    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569\": container with ID starting with 05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569 not found: ID does not exist" containerID="05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569"
Oct 30 19:19:51.072127 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.072074    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569"} err="failed to get container status \"05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569\": rpc error: code = NotFound desc = could not find container \"05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569\": container with ID starting with 05a3cd93153a23a14362f995e45a69e85d67e5687435c23dd0e2e0cde27f0569 not found: ID does not exist"
Oct 30 19:19:51.072127 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.072099    5652 scope.go:122] "RemoveContainer" containerID="c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"
Oct 30 19:19:51.072414 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:51.072397    5652 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed\": container with ID starting with c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed not found: ID does not exist" containerID="c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"
Oct 30 19:19:51.072476 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.072421    5652 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed"} err="failed to get container status \"c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed\": rpc error: code = NotFound desc = could not find container \"c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed\": container with ID starting with c5ccc8a35cb6ab3aaa9e2283cd14393eadc6fdd5e09de5aa716ab36f8b53ffed not found: ID does not exist"
Oct 30 19:19:51.083170 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:19:51.083149    5652 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-2gcwp\" is forbidden: User \"system:node:ip-10-0-133-244.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9lr6s\": no relationship found between node 'ip-10-0-133-244.us-west-2.compute.internal' and this object" podUID="5717231c-c038-4fd3-8fb3-33231f014710" pod="openshift-must-gather-9lr6s/must-gather-2gcwp"
Oct 30 19:19:51.126739 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.126720    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm\" (UniqueName: \"kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm\") pod \"5717231c-c038-4fd3-8fb3-33231f014710\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") "
Oct 30 19:19:51.126828 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.126772    5652 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output\") pod \"5717231c-c038-4fd3-8fb3-33231f014710\" (UID: \"5717231c-c038-4fd3-8fb3-33231f014710\") "
Oct 30 19:19:51.128021 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.127997    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output" pod "5717231c-c038-4fd3-8fb3-33231f014710" (UID: "5717231c-c038-4fd3-8fb3-33231f014710"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:19:51.128623 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.128604    5652 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm" pod "5717231c-c038-4fd3-8fb3-33231f014710" (UID: "5717231c-c038-4fd3-8fb3-33231f014710"). InnerVolumeSpecName "kube-api-access-8xtpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:19:51.227747 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.227701    5652 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xtpm\" (UniqueName: \"kubernetes.io/projected/5717231c-c038-4fd3-8fb3-33231f014710-kube-api-access-8xtpm\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:19:51.227747 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:51.227723    5652 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5717231c-c038-4fd3-8fb3-33231f014710-must-gather-output\") on node \"ip-10-0-133-244.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:19:52.226756 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:52.226717    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:52.416014 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:52.415980    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:19:53.040440 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:53.040407    5652 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5717231c-c038-4fd3-8fb3-33231f014710" path="/var/lib/kubelet/pods/5717231c-c038-4fd3-8fb3-33231f014710/volumes"
Oct 30 19:19:55.878409 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:55.878385    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rq9kn_8c63e418-061c-4f79-9d26-28fe2adba2cc/global-pull-secret-syncer/0.log"
Oct 30 19:19:57.707786 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:57.707754    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log"
Oct 30 19:19:59.665552 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:19:59.665523    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal_280f4af3efbb64161ef5d0dff38bf2c2/haproxy/0.log"
Oct 30 19:20:10.820627 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:20:10.820588    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:20:25.348923 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:25.348885    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:20:40.820533 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:20:40.820442    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:20:42.094803 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:42.094766    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:20:55.149925 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:55.149901    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/alertmanager/0.log"
Oct 30 19:20:55.578257 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:55.578214    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/config-reloader/0.log"
Oct 30 19:20:56.010468 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:56.010388    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/kube-rbac-proxy-web/0.log"
Oct 30 19:20:56.439807 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:56.439782    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/kube-rbac-proxy/0.log"
Oct 30 19:20:56.870041 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:56.870015    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/kube-rbac-proxy-metric/0.log"
Oct 30 19:20:57.297493 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:57.297422    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/prom-label-proxy/0.log"
Oct 30 19:20:57.732865 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:57.732838    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_77141143-0ae3-4a7d-ba64-9bab0c3bf939/init-config-reloader/0.log"
Oct 30 19:20:58.693936 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:58.693908    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8d95l_0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/kube-state-metrics/0.log"
Oct 30 19:20:59.171988 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:59.171957    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8d95l_0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/kube-rbac-proxy-main/0.log"
Oct 30 19:20:59.599813 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:20:59.599788    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8d95l_0a8a5d1c-491a-4031-86cc-d5fbe2d07f62/kube-rbac-proxy-self/0.log"
Oct 30 19:21:00.031647 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:00.031580    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c898556f7-rxxgm_b369e7ad-ff3d-4a1e-9031-906027c85d2a/metrics-server/0.log"
Oct 30 19:21:03.504769 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:03.504741    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztgh2_fd305194-b939-401e-a5d0-b0f38e8aae86/node-exporter/0.log"
Oct 30 19:21:03.931334 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:03.931305    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztgh2_fd305194-b939-401e-a5d0-b0f38e8aae86/kube-rbac-proxy/0.log"
Oct 30 19:21:04.378360 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:04.378338    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztgh2_fd305194-b939-401e-a5d0-b0f38e8aae86/init-textfile/0.log"
Oct 30 19:21:04.813245 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:04.813203    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-krdfp_6d02e71e-b1a9-4e13-85a2-92435ed108c6/kube-rbac-proxy-main/0.log"
Oct 30 19:21:05.241638 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:05.241569    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-krdfp_6d02e71e-b1a9-4e13-85a2-92435ed108c6/kube-rbac-proxy-self/0.log"
Oct 30 19:21:05.677324 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:05.677289    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-krdfp_6d02e71e-b1a9-4e13-85a2-92435ed108c6/openshift-state-metrics/0.log"
Oct 30 19:21:06.119355 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:06.119318    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/prometheus/0.log"
Oct 30 19:21:06.543147 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:06.543081    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/config-reloader/0.log"
Oct 30 19:21:06.977493 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:06.977461    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/thanos-sidecar/0.log"
Oct 30 19:21:07.418410 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:07.418384    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/kube-rbac-proxy-web/0.log"
Oct 30 19:21:07.867732 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:07.867686    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/kube-rbac-proxy/0.log"
Oct 30 19:21:08.317529 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.317500    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/kube-rbac-proxy-thanos/0.log"
Oct 30 19:21:08.354146 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354116    5652 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"]
Oct 30 19:21:08.354417 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354402    5652 cpu_manager.go:414] "containerMap: removing container" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="copy"
Oct 30 19:21:08.354417 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354417    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="copy"
Oct 30 19:21:08.354554 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354445    5652 cpu_manager.go:414] "containerMap: removing container" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="gather"
Oct 30 19:21:08.354554 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354450    5652 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="gather"
Oct 30 19:21:08.354554 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354499    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="gather"
Oct 30 19:21:08.354554 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.354509    5652 memory_manager.go:365] "RemoveStaleState removing state" podUID="5717231c-c038-4fd3-8fb3-33231f014710" containerName="copy"
Oct 30 19:21:08.360123 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.360098    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.435648 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.435614    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"]
Oct 30 19:21:08.453998 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.453967    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-proc\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.454144 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.454013    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-podres\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.454144 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.454082    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49kc\" (UniqueName: \"kubernetes.io/projected/caff55fe-b806-41b9-9fab-53d7feab09e2-kube-api-access-q49kc\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.454144 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.454134    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-lib-modules\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.454294 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.454155    5652 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-sys\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555178 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555150    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-lib-modules\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555190    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-sys\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555246    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-proc\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555297    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-podres\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555300    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-sys\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555305    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-proc\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555307    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-lib-modules\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555340 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555326    5652 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q49kc\" (UniqueName: \"kubernetes.io/projected/caff55fe-b806-41b9-9fab-53d7feab09e2-kube-api-access-q49kc\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.555625 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.555431    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caff55fe-b806-41b9-9fab-53d7feab09e2-podres\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.615757 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.615698    5652 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49kc\" (UniqueName: \"kubernetes.io/projected/caff55fe-b806-41b9-9fab-53d7feab09e2-kube-api-access-q49kc\") pod \"perf-node-gather-daemonset-7ftbc\" (UID: \"caff55fe-b806-41b9-9fab-53d7feab09e2\") " pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.674247 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.674208    5652 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:08.787416 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:08.787385    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fdc0656d-bf19-4ed8-a70c-e44afb11dea5/init-config-reloader/0.log"
Oct 30 19:21:09.042169 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:09.042103    5652 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"]
Oct 30 19:21:09.045202 ip-10-0-133-244 kubenswrapper[5652]: W1030 19:21:09.045169    5652 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcaff55fe_b806_41b9_9fab_53d7feab09e2.slice/crio-88577bd7840d972e0945a17a1c93b92ea8eccdc6dcdf9d76233d5549b26075b6 WatchSource:0}: Error finding container 88577bd7840d972e0945a17a1c93b92ea8eccdc6dcdf9d76233d5549b26075b6: Status 404 returned error can't find the container with id 88577bd7840d972e0945a17a1c93b92ea8eccdc6dcdf9d76233d5549b26075b6
Oct 30 19:21:09.347292 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:09.347254    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc" event={"ID":"caff55fe-b806-41b9-9fab-53d7feab09e2","Type":"ContainerStarted","Data":"4b7ac35b20159ac06ed15d22114e17710afc12b39ee62f162002154db67993c2"}
Oct 30 19:21:09.347475 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:09.347333    5652 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc" event={"ID":"caff55fe-b806-41b9-9fab-53d7feab09e2","Type":"ContainerStarted","Data":"88577bd7840d972e0945a17a1c93b92ea8eccdc6dcdf9d76233d5549b26075b6"}
Oct 30 19:21:09.347475 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:09.347376    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:09.459754 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:09.459698    5652 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc" podStartSLOduration=1.4596839369999999 podStartE2EDuration="1.459683937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:21:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:21:09.459682456 +0000 UTC m=+2558.540352830" watchObservedRunningTime="2026-10-30 19:21:09.459683937 +0000 UTC m=+2558.540354310"
Oct 30 19:21:10.825834 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:21:10.825793    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:21:15.363653 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:15.363625    5652 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-24xkm/perf-node-gather-daemonset-7ftbc"
Oct 30 19:21:31.668878 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:31.668846    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7k2jl_1cdddf29-8df1-457c-b881-e50bf4cd6898/dns/0.log"
Oct 30 19:21:32.094019 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:32.093998    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7k2jl_1cdddf29-8df1-457c-b881-e50bf4cd6898/kube-rbac-proxy/0.log"
Oct 30 19:21:33.801154 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:33.801128    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hqx6v_db75277c-76a4-4127-b5c2-d6bead6f6db2/dns-node-resolver/0.log"
Oct 30 19:21:38.387192 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:38.387161    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wn9rz_f7f00c4d-1310-4e08-ba66-d9720844b86f/node-ca/0.log"
Oct 30 19:21:40.827809 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:21:40.827741    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"
Oct 30 19:21:42.424872 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:42.424843    5652 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g66m2_4a029bb1-97b8-4018-94f9-20b06c34db89/konnectivity-agent/0.log" limit=1024
Oct 30 19:21:45.790576 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:45.790536    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jlkk2_56cefe62-35cf-4953-937e-f46b87c1a928/serve-healthcheck-canary/0.log"
Oct 30 19:21:46.341558 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:46.341511    5652 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-244.us-west-2.compute.internal" podUID="280f4af3efbb64161ef5d0dff38bf2c2" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Oct 30 19:21:50.409593 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:50.409554    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk68x_4a20b4f4-576f-4153-925a-3441a17d73d9/kube-rbac-proxy/0.log"
Oct 30 19:21:50.844099 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:50.844069    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk68x_4a20b4f4-576f-4153-925a-3441a17d73d9/exporter/0.log"
Oct 30 19:21:51.272171 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:21:51.272097    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk68x_4a20b4f4-576f-4153-925a-3441a17d73d9/extractor/0.log"
Oct 30 19:22:00.293322 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:22:00.293281    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qnzz8_bb22273e-bf87-493a-8bfe-bcccd4c56c07/s3-init/0.log"
Oct 30 19:22:00.708556 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:22:00.708522    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qnzz8_bb22273e-bf87-493a-8bfe-bcccd4c56c07/download-hf-model/0.log"
Oct 30 19:22:01.139527 ip-10-0-133-244 kubenswrapper[5652]: I1030 19:22:01.139499    5652 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-78bb9c6ff8-8f9s2_c5a656d5-6f1e-4098-86c2-3a9f3e537015/seaweedfs/0.log"
Oct 30 19:22:10.821022 ip-10-0-133-244 kubenswrapper[5652]: E1030 19:22:10.820937    5652 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nk68x" containerName="extractor"