Oct 30 18:34:22.544091 ip-10-0-135-34 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 18:34:22.544103 ip-10-0-135-34 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 18:34:22.544110 ip-10-0-135-34 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 18:34:22.544320 ip-10-0-135-34 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 18:34:33.863707 ip-10-0-135-34 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 18:34:33.863726 ip-10-0-135-34 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4196858161ea42e6bbb3217dc75d1db7 --
Oct 30 18:36:29.076951 ip-10-0-135-34 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 18:36:29.497822 ip-10-0-135-34 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:36:29.497822 ip-10-0-135-34 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 18:36:29.497822 ip-10-0-135-34 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:36:29.497822 ip-10-0-135-34 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:36:29.502253 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502148    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.502253 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502255    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502258    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502263    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502267    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502271    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502274    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502276    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502279    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502282    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502284    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502287    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502290    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502292    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502295    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502297    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502300    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502303    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502305    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502308    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.502315 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502310    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502313    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502323    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502326    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502329    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502332    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502334    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502337    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502340    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502343    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502345    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502348    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502350    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502353    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502355    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502358    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502360    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502363    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502365    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.502755 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502368    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502370    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502373    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502376    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502378    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502380    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502383    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502385    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502388    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502390    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502393    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502395    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502397    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502400    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502402    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502406    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502409    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502412    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502414    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502417    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.503179 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502419    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502424    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502427    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502429    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502432    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502435    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502437    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502440    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502442    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502445    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502447    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502450    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502452    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502455    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502457    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502460    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502462    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502464    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502467    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.503620 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502469    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502472    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502474    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502477    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502479    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502482    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502484    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502487    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502490    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502493    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502497    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502500    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502502    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502505    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502508    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502510    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502513    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502515    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502518    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502520    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.504117 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502523    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502525    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502528    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502531    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502533    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502536    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502538    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.502541    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503419    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503428    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503433    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503436    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503439    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503442    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503444    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503447    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503450    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503453    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503455    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.504568 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503458    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503461    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503464    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503467    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503476    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503479    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503482    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503484    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503487    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503490    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503492    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503495    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503497    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503499    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503502    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503505    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503507    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503510    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503512    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.505110 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503517    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503520    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503523    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503525    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503528    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503531    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503534    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503537    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503539    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503542    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503544    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503547    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503549    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503552    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503555    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503557    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503560    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503563    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503571    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503574    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.505546 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503577    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503579    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503582    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503584    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503587    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503589    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503592    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503594    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503597    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503599    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503602    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503604    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503606    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503609    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503611    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503614    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503617    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503619    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503622    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.506276 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503625    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503628    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503630    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503633    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503636    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503638    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503641    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503644    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503647    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503665    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503668    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503671    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503679    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503682    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503685    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503687    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503690    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503693    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503695    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503698    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.506967 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503700    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503703    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503706    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503708    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503711    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503713    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503716    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503718    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503721    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503724    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503727    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503730    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503735    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503738    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503742    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503745    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.503748    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504296    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504301    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.507680 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504304    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504307    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504310    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504312    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504315    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504323    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504326    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504329    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504332    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504334    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504337    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504340    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504343    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504345    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504348    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504350    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504353    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504356    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504358    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.508126 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504361    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504363    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504366    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504372    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504374    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504377    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504380    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504382    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504385    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504387    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504390    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504393    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504396    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504400    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504404    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504407    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504410    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504412    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504415    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.508565 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504423    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504426    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504428    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504431    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504434    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504436    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504439    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504441    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504444    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504446    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504450    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504452    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504455    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504457    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504460    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504462    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504467    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504470    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504472    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504475    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.509061 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504477    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504480    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504482    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504485    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504488    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504490    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504493    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504495    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504498    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504500    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504503    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504505    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504508    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504516    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504518    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504521    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504524    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504526    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504529    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.509524 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504531    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504534    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504536    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504539    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504541    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504544    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504546    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504549    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504553    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504556    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504559    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504562    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504564    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504566    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504569    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504572    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504574    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504577    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504580    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504582    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.510010 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504585    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504588    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504591    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504595    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504598    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504600    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.504604    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505753    2576 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505777    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505789    2576 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505796    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505804    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505809    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505816    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505822    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505827    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505832    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505838    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505844    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505863    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505868    2576 flags.go:64] FLAG: --cgroup-root=""
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505872    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505877    2576 flags.go:64] FLAG: --client-ca-file=""
Oct 30 18:36:29.510474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505882    2576 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505887    2576 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505894    2576 flags.go:64] FLAG: --cluster-domain=""
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505899    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505904    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505910    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505915    2576 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505922    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505926    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505931    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505936    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505941    2576 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505946    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505951    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505956    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505960    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505968    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505973    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505978    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505983    2576 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505988    2576 flags.go:64] FLAG: --enable-server="true"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.505993    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506005    2576 flags.go:64] FLAG: --event-burst="100"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506010    2576 flags.go:64] FLAG: --event-qps="50"
Oct 30 18:36:29.511001 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506015    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506020    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506024    2576 flags.go:64] FLAG: --eviction-hard=""
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506031    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506035    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506047    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506053    2576 flags.go:64] FLAG: --eviction-soft=""
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506058    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506063    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506068    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506072    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506077    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506081    2576 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506086    2576 flags.go:64] FLAG: --feature-gates=""
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506092    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506097    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506102    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506107    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506112    2576 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506117    2576 flags.go:64] FLAG: --help="false"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506121    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506126    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506131    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 18:36:29.511595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506136    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506142    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506148    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506153    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506158    2576 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506162    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506167    2576 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506172    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506177    2576 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506182    2576 flags.go:64] FLAG: --kube-reserved=""
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506186    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506973    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.506996    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507003    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507009    2576 flags.go:64] FLAG: --lock-file=""
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507014    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507020    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507026    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507037    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507049    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507054    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507059    2576 flags.go:64] FLAG: --logging-format="text"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507064    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507069    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 18:36:29.512153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507074    2576 flags.go:64] FLAG: --manifest-url=""
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507079    2576 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507087    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507092    2576 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507103    2576 flags.go:64] FLAG: --max-pods="110"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507108    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507113    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507117    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507123    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507127    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507132    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507137    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507156    2576 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507161    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507166    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507170    2576 flags.go:64] FLAG: --pod-cidr=""
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507175    2576 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507180    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507184    2576 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507194    2576 flags.go:64] FLAG: --port="10250"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507201    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507207    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0d3ca12c0c8ddea80"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507212    2576 flags.go:64] FLAG: --qos-reserved=""
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507217    2576 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507221    2576 flags.go:64] FLAG: --register-node="true"
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507226    2576 flags.go:64] FLAG: --register-with-taints=""
Oct 30 18:36:29.512727 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507232    2576 flags.go:64] FLAG: --registry-burst="10"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507237    2576 flags.go:64] FLAG: --registry-qps="5"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507246    2576 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507250    2576 flags.go:64] FLAG: --reserved-memory=""
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507257    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507261    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507266    2576 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507271    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507275    2576 flags.go:64] FLAG: --runonce="false"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507280    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507290    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507294    2576 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507299    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507303    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507308    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507312    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507317    2576 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507322    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507326    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507335    2576 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507339    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507344    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507349    2576 flags.go:64] FLAG: --system-cgroups=""
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507353    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507364    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 18:36:29.513372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507374    2576 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507379    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507387    2576 flags.go:64] FLAG: --tls-min-version=""
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507391    2576 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507396    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507400    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507406    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507410    2576 flags.go:64] FLAG: --v="2"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507456    2576 flags.go:64] FLAG: --version="false"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507461    2576 flags.go:64] FLAG: --vmodule=""
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507465    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.507469    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507795    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507806    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507810    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507813    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507816    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507819    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507822    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507825    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507827    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507830    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.513990 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507833    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507835    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507838    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507842    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507847    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507850    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507853    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507856    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507858    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507861    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507864    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507867    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507869    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507872    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507875    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507877    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507880    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507883    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507885    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.514553 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507888    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507891    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507894    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507897    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507899    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507902    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507904    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507906    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507909    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507911    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507914    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507917    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507919    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507922    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507924    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507927    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507930    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507932    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507935    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507938    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.515025 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507940    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507942    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507945    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507948    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507951    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507954    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507956    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507959    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507961    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507964    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507967    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507969    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507972    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507974    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507977    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507979    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507982    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507984    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507987    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507990    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.515477 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507992    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507994    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507997    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.507999    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508008    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508012    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508015    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508017    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508020    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508022    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508025    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508027    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508030    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508033    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508036    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508039    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508048    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508051    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508054    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.515958 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508057    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508059    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508062    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508065    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508067    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508070    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508072    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508075    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508078    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508080    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508083    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508085    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508088    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508090    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508093    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508095    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508098    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.516407 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508100    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.508134    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508170    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508174    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508177    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508180    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508183    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508186    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508190    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508193    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508196    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508199    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508203    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508205    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508208    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508211    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.516828 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508213    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508216    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508218    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508221    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508223    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508226    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508228    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508231    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508234    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508236    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508239    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508241    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508244    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508247    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508249    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508253    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508257    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508261    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508270    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.517207 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508274    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508276    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508279    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508281    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508284    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508286    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508289    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508291    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508294    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508298    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508300    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508303    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508305    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508308    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508310    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508313    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508315    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508318    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508320    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.517644 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508323    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508326    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508329    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508332    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508334    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508337    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508339    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508342    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508344    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508347    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508349    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508352    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508355    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508363    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508366    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508369    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508371    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508374    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508376    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508379    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.518099 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508381    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508384    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508389    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508391    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508394    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508396    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508399    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508401    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508404    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508406    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508409    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508411    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508414    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508418    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508420    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508423    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508425    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508428    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508430    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508433    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.518563 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508436    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508438    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508441    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508443    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508445    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508448    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508456    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508459    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508463    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508466    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508470    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508473    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508475    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.508478    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.516067    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.516083    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.516098    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.516103    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516168    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.519069 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516174    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516177    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516180    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516182    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516185    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516188    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516190    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516193    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516196    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516198    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516201    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516204    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516207    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516209    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516212    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516214    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516217    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516219    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516222    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516224    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.519497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516227    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516229    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516232    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516234    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516237    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516239    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516242    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516246    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516251    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516255    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516257    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516260    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516262    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516265    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516267    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516270    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516272    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516275    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516277    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.519975 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516280    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516282    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516285    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516287    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516290    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516292    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516295    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516298    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516300    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516303    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516305    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516308    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516310    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516312    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516315    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516318    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516320    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516322    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516325    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516328    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.520422 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516331    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516334    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516337    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516340    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516342    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516345    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516348    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516350    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516352    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516355    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516357    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516360    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516363    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516365    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516368    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516370    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516373    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516375    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516378    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.520901 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516380    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516382    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516385    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516387    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516390    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516392    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516395    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516397    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516401    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516405    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516409    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516412    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516414    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516417    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516420    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516422    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516425    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516428    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516430    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.521471 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516433    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516435    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516437    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516440    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516442    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516444    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516447    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516449    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.516477    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516673    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516679    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516682    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516685    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516687    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516690    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516692    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516695    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.522087 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516697    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516700    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516702    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516705    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516708    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516710    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516713    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516716    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516719    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516721    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516725    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516727    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516730    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516733    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516736    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516738    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516741    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516743    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516746    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516748    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.522513 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516751    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516753    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516756    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516758    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516761    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516763    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516765    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516768    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516770    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516773    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516775    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516779    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516783    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516786    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516790    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516792    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516795    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516798    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516800    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.523048 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516803    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516806    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516810    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516813    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516816    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516818    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516821    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516824    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516827    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516829    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516832    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516834    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516837    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516839    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516842    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516844    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516847    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516849    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516852    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.523497 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516854    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516857    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516860    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516862    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516865    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516867    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516870    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516872    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516875    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516878    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516880    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516883    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516885    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516888    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516890    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516893    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516895    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516898    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516900    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516902    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.524082 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516905    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516909    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516911    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516914    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516916    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516919    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516921    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516924    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516926    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516929    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516931    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516934    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516936    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516939    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516941    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516944    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516946    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516948    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516951    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.524917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.516953    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.516977    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517017    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517029    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517033    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517035    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517038    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517041    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517043    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517046    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517048    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517051    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517053    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517056    2576 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517058    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517062    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517064    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:36:29.525363 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517067    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517069    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517072    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517074    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517077    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517079    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517082    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517084    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517087    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517089    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517092    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517094    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517096    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517099    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517102    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517104    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517107    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517109    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517112    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:36:29.525863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517114    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517117    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517120    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517122    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517125    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517127    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517131    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517135    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517137    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517140    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517143    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517145    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517148    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517151    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517153    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517157    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517160    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517164    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517167    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:36:29.526321 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517169    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517172    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517175    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517177    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517180    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517182    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517185    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517187    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517190    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517192    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517194    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517197    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517199    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517202    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517207    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517210    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517213    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517215    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517218    2576 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517221    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:36:29.526948 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517224    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517226    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517229    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517231    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517234    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517236    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517239    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517242    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517244    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517247    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517249    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517252    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517254    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517257    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517260    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517262    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517265    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517268    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517270    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517273    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:36:29.527481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517275    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517278    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517280    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517283    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517285    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517288    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517293    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517296    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517299    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517301    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517304    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517306    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:29.517309    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.517399    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.519807    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.520895    2576 server.go:1014] "Starting client certificate rotation"
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.521001    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 18:36:29.528065 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.521060    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 18:36:29.528460 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.523156    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:36:29.528460 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.526081    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:36:29.536694 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.536671    2576 log.go:25] "Validated CRI v1 runtime API"
Oct 30 18:36:29.540054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.540034    2576 log.go:25] "Validated CRI v1 image API"
Oct 30 18:36:29.540881 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.540858    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 18:36:29.543568 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.543544    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ad21b33a-55c8-4bdd-9d13-584043c4ddec:/dev/nvme0n1p4 e3e4f1d5-f3d5-4fa0-9216-11f6f06639af:/dev/nvme0n1p3]
Oct 30 18:36:29.543614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.543569    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 18:36:29.548773 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.548605    2576 manager.go:217] Machine: {Timestamp:2026-10-30 18:36:29.547813874 +0000 UTC m=+0.371268383 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089557 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec222c053e64b844eec0bf6e4efb0286 SystemUUID:ec222c05-3e64-b844-eec0-bf6e4efb0286 BootID:41968581-61ea-42e6-bbb3-217dc75d1db7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d6:82:1d:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d6:82:1d:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:82:18:96:39:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 18:36:29.549527 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.549515    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 18:36:29.549649 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.549630    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 18:36:29.553290 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.553263    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 18:36:29.553416 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.553291    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-34.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 18:36:29.553458 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.553419    2576 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 18:36:29.553458 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.553431    2576 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 18:36:29.553458 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.553444    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:36:29.554430 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.554420    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:36:29.555700 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.555689    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 18:36:29.560430 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560417    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 18:36:29.560547 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560537    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 18:36:29.560601 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560569    2576 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 18:36:29.560601 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560579    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 18:36:29.560601 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560589    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 18:36:29.560601 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560598    2576 kubelet.go:405] "Adding apiserver pod source"
Oct 30 18:36:29.560783 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560605    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 18:36:29.560930 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.560916    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:36:29.563401 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.563382    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 18:36:29.566745 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.566724    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 18:36:29.570474 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.570461    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:36:29.571427 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571415    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 18:36:29.571473 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571446    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 18:36:29.571610 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571600    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 18:36:29.571638 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571617    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 18:36:29.571638 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571623    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 18:36:29.571638 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571630    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 18:36:29.571726 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571638    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 18:36:29.571726 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.571666    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 18:36:29.572338 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.572330    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 18:36:29.572366 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.572339    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 18:36:29.572366 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.572346    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 18:36:29.572366 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.572352    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 18:36:29.572366 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.572367    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 18:36:29.572515 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.572376    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 18:36:29.573266 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.573257    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 18:36:29.573266 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.573267    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 18:36:29.577168 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.577154    2576 server.go:1263] "Started kubelet"
Oct 30 18:36:29.577247 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.577218    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 18:36:29.577308 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.577231    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 18:36:29.577357 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.577326    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 18:36:29.577930 ip-10-0-135-34 systemd[1]: Started Kubernetes Kubelet.
Oct 30 18:36:29.578414 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.578340    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-34.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 18:36:29.578871 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.578851    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 18:36:29.580500 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.580482    2576 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 18:36:29.582952 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.582918    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-34.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 18:36:29.583049 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.582921    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 18:36:29.583635 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.583618    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 18:36:29.586752 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.586732    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 18:36:29.587392 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.587376    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8x7h"
Oct 30 18:36:29.588165 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.588147    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 18:36:29.588292 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.588272    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:29.588944 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.588930    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 18:36:29.588944 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.588947    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 18:36:29.589089 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.588978    2576 factory.go:55] Registering systemd factory
Oct 30 18:36:29.589089 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.588991    2576 factory.go:223] Registration of the systemd container factory successfully
Oct 30 18:36:29.589089 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.588932    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 18:36:29.589089 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589070    2576 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 18:36:29.589089 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589077    2576 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 18:36:29.589336 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589188    2576 factory.go:153] Registering CRI-O factory
Oct 30 18:36:29.589336 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589200    2576 factory.go:223] Registration of the crio container factory successfully
Oct 30 18:36:29.589336 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589243    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 18:36:29.589336 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589256    2576 factory.go:103] Registering Raw factory
Oct 30 18:36:29.589336 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.589266    2576 manager.go:1199] Started watching for new ooms in manager
Oct 30 18:36:29.589541 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.588249    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-34.us-east-2.compute.internal.18e36282931ecfc8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-34.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-34.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 18:36:29.577129928 +0000 UTC m=+0.400584435,LastTimestamp:2026-10-30 18:36:29.577129928 +0000 UTC m=+0.400584435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-34.us-east-2.compute.internal,}"
Oct 30 18:36:29.590154 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.590142    2576 manager.go:319] Starting recovery of all containers
Oct 30 18:36:29.596846 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.596822    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-34.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 18:36:29.598804 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.598766    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 18:36:29.599996 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.599977    2576 manager.go:324] Recovery completed
Oct 30 18:36:29.601547 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.601523    2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Oct 30 18:36:29.602060 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.602040    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 18:36:29.602377 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.602355    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8x7h"
Oct 30 18:36:29.604881 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.604868    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.606417 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.606400    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.606476 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.606430    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.606476 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.606445    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.607004 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.606980    2576 cpu_manager.go:226] "Starting" policy="none"
Oct 30 18:36:29.607004 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.606995    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.607125 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.606994    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 18:36:29.607125 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.607061    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 18:36:29.607697 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.607678    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.607754 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.607710    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.607754 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.607725    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.609458 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.609444    2576 policy_none.go:50] "Start"
Oct 30 18:36:29.609518 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.609462    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 18:36:29.609518 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.609480    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 18:36:29.611528 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.611515    2576 policy_none.go:44] "Start"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.653227    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.657610    2576 manager.go:341] "Starting Device Plugin manager"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.658248    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.658258    2576 server.go:87] "Starting device plugin registration server"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.658467    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.658477    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.658566    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.658637    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.658645    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.659153    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.659202    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.664583    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.664602    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.664620    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.664669    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 18:36:29.672796 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.668320    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:36:29.758595 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.758537    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.759353 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.759335    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.759408 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.759382    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.759408 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.759394    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.759480 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.759413    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.765297 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.765279    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"]
Oct 30 18:36:29.765361 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.765328    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.766011 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.765998    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.766070 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.766022    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.766070 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.766031    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.768264 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.768252    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.768408 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.768393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.768443 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.768424    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.768678 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.768666    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.768727 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.768685    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-34.us-east-2.compute.internal\": node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:29.769034 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.769011    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.769128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.769048    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.769128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.769063    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.769128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.769075    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.769128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.769101    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.769128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.769116    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.771187 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.771169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.771272 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.771200    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:36:29.771835 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.771817    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:36:29.771905 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.771849    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:36:29.771905 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.771863    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:36:29.785840 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.785820    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:29.796099 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.796082    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.798751 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.798736    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.886698 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.886677    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:29.890005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.889990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.890076 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.890019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.890127 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.890097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5556c3ea4229dba8b9cd7852950cab95-config\") pod \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"5556c3ea4229dba8b9cd7852950cab95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.987296 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:29.987271    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:29.990568 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.990550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.990647 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.990577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.990647 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.990596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5556c3ea4229dba8b9cd7852950cab95-config\") pod \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"5556c3ea4229dba8b9cd7852950cab95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.990647 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.990618    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.990647 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.990640    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5556c3ea4229dba8b9cd7852950cab95-config\") pod \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"5556c3ea4229dba8b9cd7852950cab95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:29.990820 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:29.990682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:30.087969 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.087948    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.101366 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.101350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:30.104525 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.104507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:30.188722 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.188695    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.289112 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.289077    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.389523 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.389461    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.489935 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.489911    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.520246 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.520224    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 18:36:30.520626 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.520364    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 18:36:30.590405 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.590376    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.608732 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.608683    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:31:29 +0000 UTC" deadline="2028-07-21 11:36:13.716472086 +0000 UTC"
Oct 30 18:36:30.608732 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.608724    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15112h59m43.107751537s"
Oct 30 18:36:30.677493 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.677424    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:36:30.690512 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.690488    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.774863 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:30.774828    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5556c3ea4229dba8b9cd7852950cab95.slice/crio-aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d WatchSource:0}: Error finding container aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d: Status 404 returned error can't find the container with id aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d
Oct 30 18:36:30.775191 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:30.775171    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4c4045ca2bfba4a77d13d53f465298.slice/crio-bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50 WatchSource:0}: Error finding container bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50: Status 404 returned error can't find the container with id bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50
Oct 30 18:36:30.779641 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.779629    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 18:36:30.791435 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.791419    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.883614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.883596    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:36:30.891891 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:30.891874    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:36:30.942704 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.942644    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:36:30.988708 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:30.988689    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:31.001975 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.001958    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:36:31.003068 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.003053    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:36:31.013618 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.013599    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:36:31.437376 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.437341    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:36:31.561711 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.561668    2576 apiserver.go:52] "Watching apiserver"
Oct 30 18:36:31.581081 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.581041    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 18:36:31.581701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.581665    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kj7ts","kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal","openshift-image-registry/node-ca-9xmbq","openshift-multus/multus-bs7gv","kube-system/global-pull-secret-syncer-mr8gw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg","openshift-cluster-node-tuning-operator/tuned-8rnfp","openshift-multus/multus-additional-cni-plugins-mbn4h","openshift-multus/network-metrics-daemon-mng5f","openshift-ovn-kubernetes/ovnkube-node-d7958","openshift-dns/node-resolver-778wz","openshift-network-operator/iptables-alerter-pdp2x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal","openshift-network-diagnostics/network-check-target-gw4w2"]
Oct 30 18:36:31.584240 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.584217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.586675 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.586638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.588236 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.588218    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 18:36:31.588728 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.588707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.588941 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.588922    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4k7wf\""
Oct 30 18:36:31.589047 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.589032    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.589204 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.589188    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.590516 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.590483    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.591084 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.591067    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.592810 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.592795    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 18:36:31.592911 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.592833    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.592975 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.592935    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jfgwk\""
Oct 30 18:36:31.593234 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.592980    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.593234 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.592991    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.593234 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.593073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.593234 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.593126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:31.593234 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.593134    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-psdnm\""
Oct 30 18:36:31.595379 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.595362    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.597723 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.597703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:31.597791 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.597773    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:31.598812 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-tmp-dir\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.598913 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-hostroot\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.598913 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-conf-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.598913 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9j4b\" (UniqueName: \"kubernetes.io/projected/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-kube-api-access-r9j4b\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.598913 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-multus-certs\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-etc-kubernetes\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-kubernetes\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.598999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-lib-modules\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-tmp\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e6fda66-4524-4933-b497-2056bb7ed874-host\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cnibin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-k8s-cni-cncf-io\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599433 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-netns\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599433 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d6qg\" (UniqueName: \"kubernetes.io/projected/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-kube-api-access-9d6qg\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599433 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-modprobe-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599433 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-conf\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599433 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-hosts-file\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.599433 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cni-binary-copy\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-multus\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysconfig\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-tuned\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e6fda66-4524-4933-b497-2056bb7ed874-serviceca\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-kubelet\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-daemon-config\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599648 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-run\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599863 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-sys\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599863 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-bin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599863 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-socket-dir-parent\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599863 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsv66\" (UniqueName: \"kubernetes.io/projected/4e6fda66-4524-4933-b497-2056bb7ed874-kube-api-access-jsv66\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.599996 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-system-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.599996 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599996 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-systemd\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599996 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-var-lib-kubelet\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.599996 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.599983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmsx\" (UniqueName: \"kubernetes.io/projected/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-kube-api-access-zrmsx\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.600129 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.600006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.600129 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.600029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-host\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.600294 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.600274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:31.600362 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.600342    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:31.602229 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.602209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.602864 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.602841    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 18:36:31.604554 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.604538    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.607244 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.607228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.609236 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.609220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.631544 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.631524    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pkzg6"
Oct 30 18:36:31.643773 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.643752    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pkzg6"
Oct 30 18:36:31.669452 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.669410    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"5556c3ea4229dba8b9cd7852950cab95","Type":"ContainerStarted","Data":"aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d"}
Oct 30 18:36:31.670630 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.670607    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"ac4c4045ca2bfba4a77d13d53f465298","Type":"ContainerStarted","Data":"bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50"}
Oct 30 18:36:31.690148 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.690095    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 18:36:31.700514 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-modprobe-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-conf\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.700614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-sys-fs\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.700614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-ovn\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.700614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysconfig\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-tuned\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e6fda66-4524-4933-b497-2056bb7ed874-serviceca\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-device-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4xzz\" (UniqueName: \"kubernetes.io/projected/ab645310-3a44-4917-ab17-6f4a9e26763b-kube-api-access-d4xzz\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-run\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-bin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d580e1-86c1-41a5-b0ed-3c846111d6b4-konnectivity-ca\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-system-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-systemd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qxzj\" (UniqueName: \"kubernetes.io/projected/3e958fd3-b9bf-455f-a339-39de790991ee-kube-api-access-4qxzj\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-systemd\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.700982 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-netd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.700996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-host\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-tmp-dir\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-hostroot\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-dbus\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtgzc\" (UniqueName: \"kubernetes.io/projected/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kube-api-access-vtgzc\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-netns\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701164    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-slash\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-var-lib-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-kubernetes\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-tmp\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e6fda66-4524-4933-b497-2056bb7ed874-host\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-netns\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-systemd-units\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-hosts-file\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.701882 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cni-binary-copy\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-multus\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-log-socket\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-config\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-env-overrides\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-script-lib\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-kubelet\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-daemon-config\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701563    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-registration-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.701887    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-tmp-dir\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702041    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-run\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-bin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-system-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-node-log\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-sys\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-socket-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.702900 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovn-node-metrics-cert\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d580e1-86c1-41a5-b0ed-3c846111d6b4-agent-certs\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab645310-3a44-4917-ab17-6f4a9e26763b-iptables-alerter-script\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-socket-dir-parent\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsv66\" (UniqueName: \"kubernetes.io/projected/4e6fda66-4524-4933-b497-2056bb7ed874-kube-api-access-jsv66\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-kubelet-config\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-var-lib-kubelet\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmsx\" (UniqueName: \"kubernetes.io/projected/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-kube-api-access-zrmsx\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702448    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-modprobe-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-kubelet\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702492    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-host\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-conf-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.704005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-conf\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-system-cni-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-cnibin\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-systemd\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cftgr\" (UniqueName: \"kubernetes.io/projected/94271eb5-adea-4fe1-a166-baae2421784f-kube-api-access-cftgr\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702700    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-netns\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-etc-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-hostroot\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9j4b\" (UniqueName: \"kubernetes.io/projected/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-kube-api-access-r9j4b\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-var-lib-kubelet\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702356    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e6fda66-4524-4933-b497-2056bb7ed874-serviceca\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.702859    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-kubernetes\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703130    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703156    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703226    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-conf-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e6fda66-4524-4933-b497-2056bb7ed874-host\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-hosts-file\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.705075 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703405    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-multus\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703453    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-kubelet\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703518    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-sys\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-multus-certs\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-etc-kubernetes\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-bin\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbcq8\" (UniqueName: \"kubernetes.io/projected/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-kube-api-access-sbcq8\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-lib-modules\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cnibin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-k8s-cni-cncf-io\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d6qg\" (UniqueName: \"kubernetes.io/projected/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-kube-api-access-9d6qg\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.703879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab645310-3a44-4917-ab17-6f4a9e26763b-host-slash\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.704122    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-multus-certs\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.704165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-etc-kubernetes\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.704272    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-lib-modules\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.704315    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cnibin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.704349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-k8s-cni-cncf-io\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.706285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.704586    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysconfig\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.708214 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.706668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-socket-dir-parent\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.708214 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.707165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-tuned\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.710091 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.710072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-tmp\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.719842    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rwngh\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.719968    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720031    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720172    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720252    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720512    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mkp5v\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720561    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720594    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720734    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720742    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720805    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720819    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720812    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 18:36:31.720846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720805    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 18:36:31.721388 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720848    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 18:36:31.721388 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.720886    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 18:36:31.721598 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.721582    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 18:36:31.722587 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722567    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdfmc\""
Oct 30 18:36:31.722587 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722570    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 18:36:31.722744 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722604    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 18:36:31.722744 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722643    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 18:36:31.722744 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722688    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r9gnp\""
Oct 30 18:36:31.722744 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722697    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 18:36:31.722744 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722713    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mrncz\""
Oct 30 18:36:31.722897 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.722803    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 18:36:31.724700 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.724289    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-daemon-config\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.724700 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.724634    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cni-binary-copy\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.729645 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.729624    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmsx\" (UniqueName: \"kubernetes.io/projected/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-kube-api-access-zrmsx\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.729764 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.729739    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d6qg\" (UniqueName: \"kubernetes.io/projected/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-kube-api-access-9d6qg\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.731022 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.731004    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsv66\" (UniqueName: \"kubernetes.io/projected/4e6fda66-4524-4933-b497-2056bb7ed874-kube-api-access-jsv66\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.735614 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.735593    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9j4b\" (UniqueName: \"kubernetes.io/projected/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-kube-api-access-r9j4b\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.741533 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.741512    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-whw2z\""
Oct 30 18:36:31.804843 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-systemd-units\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.804992 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-log-socket\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.804992 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-config\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.804992 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-env-overrides\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.804992 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-script-lib\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.804992 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-registration-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.804992 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-node-log\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.804992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-socket-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovn-node-metrics-cert\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d580e1-86c1-41a5-b0ed-3c846111d6b4-agent-certs\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab645310-3a44-4917-ab17-6f4a9e26763b-iptables-alerter-script\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-kubelet-config\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-kubelet\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-system-cni-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-cnibin\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cftgr\" (UniqueName: \"kubernetes.io/projected/94271eb5-adea-4fe1-a166-baae2421784f-kube-api-access-cftgr\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.805288 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-etc-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-bin\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbcq8\" (UniqueName: \"kubernetes.io/projected/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-kube-api-access-sbcq8\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab645310-3a44-4917-ab17-6f4a9e26763b-host-slash\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-sys-fs\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-ovn\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-device-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4xzz\" (UniqueName: \"kubernetes.io/projected/ab645310-3a44-4917-ab17-6f4a9e26763b-kube-api-access-d4xzz\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d580e1-86c1-41a5-b0ed-3c846111d6b4-konnectivity-ca\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-systemd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qxzj\" (UniqueName: \"kubernetes.io/projected/3e958fd3-b9bf-455f-a339-39de790991ee-kube-api-access-4qxzj\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806000 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-netd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-dbus\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtgzc\" (UniqueName: \"kubernetes.io/projected/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kube-api-access-vtgzc\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-netns\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-slash\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-var-lib-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.805979    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-var-lib-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.806022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-systemd-units\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.806077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-log-socket\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.806790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.806569    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-config\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.806915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-env-overrides\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.806976    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807032    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab645310-3a44-4917-ab17-6f4a9e26763b-host-slash\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807062    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807100    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-kubelet\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.807130    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.807200    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:36:32.307170906 +0000 UTC m=+3.130625416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807240    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.807259 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-sys-fs\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.807807 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807293    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-cnibin\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.807807 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.807807 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.807337    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-ovn\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.808099 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.808076    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-script-lib\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.808305 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.808285    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab645310-3a44-4917-ab17-6f4a9e26763b-iptables-alerter-script\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.808376 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.808327    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.808432 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.808375    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-kubelet-config\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.808485 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.808471    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:31.808537 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.808518    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:36:32.308503989 +0000 UTC m=+3.131958488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:31.808602 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.808560    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-etc-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.808602 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.808528    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-slash\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809099 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809058    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-registration-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.809211 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809130    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-node-log\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809560 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809539    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-systemd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809653 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809593    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-system-cni-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.809653 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-bin\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809786 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809657    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-dbus\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:31.809786 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809892 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-netns\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809892 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-netd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.809892 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.809858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-device-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.810281 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.810252    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d580e1-86c1-41a5-b0ed-3c846111d6b4-konnectivity-ca\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.810646 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.810625    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.810764 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.810683    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovn-node-metrics-cert\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.810764 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.810741    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-socket-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.810764 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.810757    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d580e1-86c1-41a5-b0ed-3c846111d6b4-agent-certs\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.811186 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.811131    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.820306 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.819983    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:36:31.820306 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.820010    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:36:31.820306 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.820025    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:31.820306 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:31.820080    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:32.320064608 +0000 UTC m=+3.143519139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:31.821387 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.821342    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4xzz\" (UniqueName: \"kubernetes.io/projected/ab645310-3a44-4917-ab17-6f4a9e26763b-kube-api-access-d4xzz\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.822064 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.822023    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbcq8\" (UniqueName: \"kubernetes.io/projected/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-kube-api-access-sbcq8\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.822623 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.822601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qxzj\" (UniqueName: \"kubernetes.io/projected/3e958fd3-b9bf-455f-a339-39de790991ee-kube-api-access-4qxzj\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:31.823047 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.823022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtgzc\" (UniqueName: \"kubernetes.io/projected/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kube-api-access-vtgzc\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.823613 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.823590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cftgr\" (UniqueName: \"kubernetes.io/projected/94271eb5-adea-4fe1-a166-baae2421784f-kube-api-access-cftgr\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.899821 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.899795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:36:31.911026 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.911003    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d1b1ed_1235_4ed3_b6ab_2eadd1c17cfb.slice/crio-a96f41a4d96497ff6a9e9efdacc73f3a4fb8e4fd25ba3322e4bd0bf199015418 WatchSource:0}: Error finding container a96f41a4d96497ff6a9e9efdacc73f3a4fb8e4fd25ba3322e4bd0bf199015418: Status 404 returned error can't find the container with id a96f41a4d96497ff6a9e9efdacc73f3a4fb8e4fd25ba3322e4bd0bf199015418
Oct 30 18:36:31.913998 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.913975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-778wz"
Oct 30 18:36:31.923545 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.923522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:36:31.924685 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.924643    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad566b69_5edc_4e9b_9e58_55e8cc1f1ec2.slice/crio-bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3 WatchSource:0}: Error finding container bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3: Status 404 returned error can't find the container with id bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3
Oct 30 18:36:31.928782 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.928763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bs7gv"
Oct 30 18:36:31.933182 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.933153    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6fda66_4524_4933_b497_2056bb7ed874.slice/crio-50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e WatchSource:0}: Error finding container 50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e: Status 404 returned error can't find the container with id 50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e
Oct 30 18:36:31.939138 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.939111    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3c9b69_ac58_4a89_9c4c_0a7484f4b2c4.slice/crio-57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632 WatchSource:0}: Error finding container 57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632: Status 404 returned error can't find the container with id 57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632
Oct 30 18:36:31.940380 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.940252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:36:31.950720 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.950667    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27d0d9e_e2a4_44b2_a181_caefff4bc502.slice/crio-e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690 WatchSource:0}: Error finding container e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690: Status 404 returned error can't find the container with id e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690
Oct 30 18:36:31.957902 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.957878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:36:31.965190 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.964943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:31.967367 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.967348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:36:31.968638 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.968607    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94271eb5_adea_4fe1_a166_baae2421784f.slice/crio-8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef WatchSource:0}: Error finding container 8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef: Status 404 returned error can't find the container with id 8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef
Oct 30 18:36:31.976979 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.976955    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d580e1_86c1_41a5_b0ed_3c846111d6b4.slice/crio-cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1 WatchSource:0}: Error finding container cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1: Status 404 returned error can't find the container with id cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1
Oct 30 18:36:31.977392 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.977371    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab645310_3a44_4917_ab17_6f4a9e26763b.slice/crio-63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc WatchSource:0}: Error finding container 63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc: Status 404 returned error can't find the container with id 63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc
Oct 30 18:36:31.979538 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:31.979519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:31.989900 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:36:31.989875    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85212acf_4a7d_4d5b_b1cf_4a0e5ac7f0d2.slice/crio-7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4 WatchSource:0}: Error finding container 7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4: Status 404 returned error can't find the container with id 7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4
Oct 30 18:36:32.311152 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.311125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:32.311236 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.311175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:32.311273 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.311260    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:32.311330 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.311320    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:36:33.311306978 +0000 UTC m=+4.134761476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:32.311375 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.311265    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:32.311411 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.311402    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:36:33.311388299 +0000 UTC m=+4.134842797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:32.412412 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.412283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:32.412506 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.412425    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:36:32.412506 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.412444    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:36:32.412506 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.412453    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:32.412506 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:32.412497    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:33.412484304 +0000 UTC m=+4.235938802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:32.649239 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.649141    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:31:31 +0000 UTC" deadline="2028-06-05 09:41:59.779727283 +0000 UTC"
Oct 30 18:36:32.649239 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.649186    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14007h5m27.130545635s"
Oct 30 18:36:32.679712 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.679518    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac4c4045ca2bfba4a77d13d53f465298" containerID="2c40abe823e3bd91fa10db007db388410ddeacf4b6e8ce22c87cd38d1abcf561" exitCode=0
Oct 30 18:36:32.679712 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.679600    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"ac4c4045ca2bfba4a77d13d53f465298","Type":"ContainerDied","Data":"2c40abe823e3bd91fa10db007db388410ddeacf4b6e8ce22c87cd38d1abcf561"}
Oct 30 18:36:32.707782 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.707748    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdp2x" event={"ID":"ab645310-3a44-4917-ab17-6f4a9e26763b","Type":"ContainerStarted","Data":"63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc"}
Oct 30 18:36:32.714400 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.714370    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kj7ts" event={"ID":"33d580e1-86c1-41a5-b0ed-3c846111d6b4","Type":"ContainerStarted","Data":"cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1"}
Oct 30 18:36:32.718101 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.718072    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg" event={"ID":"f27d0d9e-e2a4-44b2-a181-caefff4bc502","Type":"ContainerStarted","Data":"e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690"}
Oct 30 18:36:32.730781 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.730715    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rnfp" event={"ID":"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb","Type":"ContainerStarted","Data":"a96f41a4d96497ff6a9e9efdacc73f3a4fb8e4fd25ba3322e4bd0bf199015418"}
Oct 30 18:36:32.733779 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.733222    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"5556c3ea4229dba8b9cd7852950cab95","Type":"ContainerStarted","Data":"ae2111a3db5262e5198570952340c69216261db2872bf622a0df39cd631e915d"}
Oct 30 18:36:32.744267 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.744202    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4"}
Oct 30 18:36:32.758453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.758424    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerStarted","Data":"8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef"}
Oct 30 18:36:32.761073 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.761047    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bs7gv" event={"ID":"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4","Type":"ContainerStarted","Data":"57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632"}
Oct 30 18:36:32.780201 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.780173    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xmbq" event={"ID":"4e6fda66-4524-4933-b497-2056bb7ed874","Type":"ContainerStarted","Data":"50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e"}
Oct 30 18:36:32.786121 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:32.786098    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-778wz" event={"ID":"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2","Type":"ContainerStarted","Data":"bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3"}
Oct 30 18:36:33.320766 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.320640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:33.320934 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.320811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:33.320994 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.320938    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:33.321050 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.321027    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:36:35.320981314 +0000 UTC m=+6.144435826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:33.321456 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.321429    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:33.321565 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.321512    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:36:35.321465595 +0000 UTC m=+6.144920107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:33.421342 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.421269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:33.421489 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.421425    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:36:33.421489 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.421445    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:36:33.421489 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.421457    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:33.421668 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.421511    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:35.421495965 +0000 UTC m=+6.244950463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:33.650050 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.649954    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:31:31 +0000 UTC" deadline="2028-04-19 04:35:40.007037242 +0000 UTC"
Oct 30 18:36:33.650050 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.650019    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12873h59m6.357022832s"
Oct 30 18:36:33.668026 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.667229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:33.668026 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.667349    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:33.668026 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.667732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:33.668026 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.667840    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:33.668026 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.667906    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:33.668026 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:33.667978    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:33.792607 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.792500    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"ac4c4045ca2bfba4a77d13d53f465298","Type":"ContainerStarted","Data":"7bcdb52b96353423cbdbbfc7f97f43cbc16795713469020c886e3181d0f888ce"}
Oct 30 18:36:33.813036 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:33.811991    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal" podStartSLOduration=2.811974782 podStartE2EDuration="2.811974782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:32.752941944 +0000 UTC m=+3.576396461" watchObservedRunningTime="2026-10-30 18:36:33.811974782 +0000 UTC m=+4.635429298"
Oct 30 18:36:35.336231 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.336201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:35.336709 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.336292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:35.336709 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.336415    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:35.336709 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.336475    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:36:39.336457638 +0000 UTC m=+10.159912136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:35.336709 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.336542    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:35.336709 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.336578    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:36:39.336565702 +0000 UTC m=+10.160020214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:35.437166 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.437128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:35.437344 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.437307    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:36:35.437344 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.437325    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:36:35.437344 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.437334    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:35.437500 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.437375    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:39.437360042 +0000 UTC m=+10.260814549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:35.667706 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.667623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:35.667863 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.667742    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:35.667863 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.667753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:35.667971 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.667868    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:35.667971 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.667930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:35.668063 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:35.668011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:35.812166 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.812127    2576 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="5339e220204d9d35189d4aa31d44a713a87f1786136c613ed3fe798dc57519b5" exitCode=0
Oct 30 18:36:35.812341 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.812194    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerDied","Data":"5339e220204d9d35189d4aa31d44a713a87f1786136c613ed3fe798dc57519b5"}
Oct 30 18:36:35.841794 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:35.841740    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" podStartSLOduration=4.841723387 podStartE2EDuration="4.841723387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:33.812990338 +0000 UTC m=+4.636444856" watchObservedRunningTime="2026-10-30 18:36:35.841723387 +0000 UTC m=+6.665177904"
Oct 30 18:36:36.817581 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:36.817538    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kj7ts" event={"ID":"33d580e1-86c1-41a5-b0ed-3c846111d6b4","Type":"ContainerStarted","Data":"3592d8bccc59d2742a2982ef9069450d80e885519a92c9c9217fc39803cba707"}
Oct 30 18:36:37.163574 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.163497    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:37.163977 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.163951    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:37.184597 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.183686    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kj7ts" podStartSLOduration=4.187001827 podStartE2EDuration="8.183668507s" totalImagesPullingTime="3.99666668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:36.837917233 +0000 UTC m=+7.661371750" watchObservedRunningTime="2026-10-30 18:36:37.183668507 +0000 UTC m=+8.007123018"
Oct 30 18:36:37.665440 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.665403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:37.665440 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.665428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:37.665690 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:37.665547    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:37.665690 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.665598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:37.665795 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:37.665705    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:37.665846 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:37.665799    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:37.823218 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.823141    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xmbq" event={"ID":"4e6fda66-4524-4933-b497-2056bb7ed874","Type":"ContainerStarted","Data":"b9a04283f90c778c042eba5e96d1b9904299f0218773d479a6022c81ff006f5e"}
Oct 30 18:36:37.830617 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.830577    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg" event={"ID":"f27d0d9e-e2a4-44b2-a181-caefff4bc502","Type":"ContainerStarted","Data":"f46c093842e13ddc7af14369fbec72c36edd0eaa8f2f1cd5f583943a4f2d6924"}
Oct 30 18:36:37.830757 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.830643    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:37.831090 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.831073    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:36:37.863773 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:37.863729    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9xmbq" podStartSLOduration=4.042708102 podStartE2EDuration="8.863712536s" totalImagesPullingTime="4.821004434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:37.845606421 +0000 UTC m=+8.669060938" watchObservedRunningTime="2026-10-30 18:36:37.863712536 +0000 UTC m=+8.687167056"
Oct 30 18:36:39.340196 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.340154    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 18:36:39.368782 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.368246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:39.368782 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.368301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:39.368782 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.368403    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:39.368782 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.368443    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:36:47.368430969 +0000 UTC m=+18.191885467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:39.368782 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.368718    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:39.368782 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.368755    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:36:47.368743159 +0000 UTC m=+18.192197668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:39.469406 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.469316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:39.469546 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.469466    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:36:39.469546 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.469491    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:36:39.469546 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.469504    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:39.469685 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.469561    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:47.469544411 +0000 UTC m=+18.292998920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:39.665835 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.665803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:39.666010 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.665914    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:39.666010 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.665948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:39.666120 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.666077    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:39.666476 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.666196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:39.666476 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:39.666279    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:39.666476 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.666345    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 18:36:39.666476 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.666369    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 18:36:39.667338 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.667177    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:36:39.340174062Z","UUID":"2f8729b9-9bea-40b1-b9b8-f115b07ba3a6","Handler":null,"Name":"","Endpoint":""}
Oct 30 18:36:39.839415 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:39.839350    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg" event={"ID":"f27d0d9e-e2a4-44b2-a181-caefff4bc502","Type":"ContainerStarted","Data":"5ec14e77dd0170b790102e90a9f9914c6ffc007bc7726cb999d3ac26c2b600c0"}
Oct 30 18:36:40.845128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.844929    2576 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="2ed0f1f279edd982154aedab8a5e577a1a354d464b3e4c5786eeb4a8cebb3085" exitCode=0
Oct 30 18:36:40.845512 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.845083    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerDied","Data":"2ed0f1f279edd982154aedab8a5e577a1a354d464b3e4c5786eeb4a8cebb3085"}
Oct 30 18:36:40.847425 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.847394    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bs7gv" event={"ID":"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4","Type":"ContainerStarted","Data":"a52f0e3e8531cf15c160a6974f6c15aa8108a41a2acbc426708f443e0539fd60"}
Oct 30 18:36:40.849379 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.849354    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-778wz" event={"ID":"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2","Type":"ContainerStarted","Data":"ff790766d886699e9d173e5f379ded49dd8ed3ee37cdbe48f1d5e29af170ae4a"}
Oct 30 18:36:40.852699 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.852258    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg" event={"ID":"f27d0d9e-e2a4-44b2-a181-caefff4bc502","Type":"ContainerStarted","Data":"6a6c9534a210cc55fd8a2c700bc073d30694cca2298807f0f6ce23c0548496fc"}
Oct 30 18:36:40.894356 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.894304    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg" podStartSLOduration=3.7587172410000003 podStartE2EDuration="11.894291381s" totalImagesPullingTime="8.13557414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:40.894066759 +0000 UTC m=+11.717521276" watchObservedRunningTime="2026-10-30 18:36:40.894291381 +0000 UTC m=+11.717745897"
Oct 30 18:36:40.912151 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.912102    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-778wz" podStartSLOduration=3.97995654 podStartE2EDuration="11.912084024s" totalImagesPullingTime="7.932127484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:40.911741891 +0000 UTC m=+11.735196409" watchObservedRunningTime="2026-10-30 18:36:40.912084024 +0000 UTC m=+11.735538541"
Oct 30 18:36:40.933454 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:40.933413    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bs7gv" podStartSLOduration=4.08625977 podStartE2EDuration="11.933402539s" totalImagesPullingTime="7.847142769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:40.933071828 +0000 UTC m=+11.756526344" watchObservedRunningTime="2026-10-30 18:36:40.933402539 +0000 UTC m=+11.756857054"
Oct 30 18:36:41.665888 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.665582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:41.665888 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.665610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:41.665888 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:41.665715    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:41.665888 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.665763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:41.666366 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:41.665863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:41.666366 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:41.666152    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:41.857585 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.857550    2576 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="fe327bf3ea6e789ee28b2b58b422707e3d22736a2a37a322b17c1c6e83858d0f" exitCode=0
Oct 30 18:36:41.858218 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.857667    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerDied","Data":"fe327bf3ea6e789ee28b2b58b422707e3d22736a2a37a322b17c1c6e83858d0f"}
Oct 30 18:36:41.859435 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.859407    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdp2x" event={"ID":"ab645310-3a44-4917-ab17-6f4a9e26763b","Type":"ContainerStarted","Data":"6da4447c93976aace45cb527a0bc34804e616e22eb104adefbb8ca51b822e887"}
Oct 30 18:36:41.903697 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:41.903622    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pdp2x" podStartSLOduration=4.876439606 podStartE2EDuration="12.903608003s" totalImagesPullingTime="8.027168397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:41.903009162 +0000 UTC m=+12.726463680" watchObservedRunningTime="2026-10-30 18:36:41.903608003 +0000 UTC m=+12.727062522"
Oct 30 18:36:42.863673 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:42.863618    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rnfp" event={"ID":"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb","Type":"ContainerStarted","Data":"5d990590b46defcb64f5ac1a91c8a053ebd00e536a08d34b497179149e03228f"}
Oct 30 18:36:42.866144 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:42.866118    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerStarted","Data":"47b4d8f698555be6e624ec2c9f20f65b098012c63eb4c68ac5a8e980d027c9f5"}
Oct 30 18:36:42.884974 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:42.884924    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8rnfp" podStartSLOduration=3.769653952 podStartE2EDuration="13.884906051s" totalImagesPullingTime="10.115252099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:42.884670525 +0000 UTC m=+13.708125034" watchObservedRunningTime="2026-10-30 18:36:42.884906051 +0000 UTC m=+13.708360571"
Oct 30 18:36:43.665109 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:43.665077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:43.665295 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:43.665200    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:43.665571 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:43.665550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:43.665691 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:43.665669    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:43.665777 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:43.665756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:43.665910 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:43.665878    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:43.871508 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:43.871467    2576 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="47b4d8f698555be6e624ec2c9f20f65b098012c63eb4c68ac5a8e980d027c9f5" exitCode=0
Oct 30 18:36:43.872053 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:43.872034    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerDied","Data":"47b4d8f698555be6e624ec2c9f20f65b098012c63eb4c68ac5a8e980d027c9f5"}
Oct 30 18:36:45.665178 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:45.664959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:45.665631 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:45.664977    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:45.665631 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:45.665275    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:45.665631 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:45.665364    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:45.665631 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:45.665036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:45.665631 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:45.665481    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:45.877846 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:45.877816    2576 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="6287f63272bd1bae3bccc289a3ace3a2f7be7784e4a27df7ca53b43f951f6a74" exitCode=0
Oct 30 18:36:45.878017 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:45.877855    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerDied","Data":"6287f63272bd1bae3bccc289a3ace3a2f7be7784e4a27df7ca53b43f951f6a74"}
Oct 30 18:36:46.882494 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.882357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:36:46.882860 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.882827    2576 generic.go:356] "Generic (PLEG): container finished" podID="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" containerID="5b83c9bbd1a51894c81533d3cb911f0bf2ff17797f24b9699cdf2cb4e955947b" exitCode=1
Oct 30 18:36:46.882934 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.882906    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"e626fcefb067b1b185e2130acaf39d891d8702577d76d4a4ea201f60ec38d631"}
Oct 30 18:36:46.883044 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.883030    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"694eff4d6055f5a76978aadd5fcb29b3dcdcef5326d247687ec5c9fba2c575fc"}
Oct 30 18:36:46.883107 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.883079    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"f8a62a57ea694a419ac01579b90bfb59d9691bb81fe59514f23b7c0580a3a225"}
Oct 30 18:36:46.883156 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.883108    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"cf43af209114ff45973825facfb9c3a6f050cb4c62585556f544f5d47d624870"}
Oct 30 18:36:46.883156 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.883135    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerDied","Data":"5b83c9bbd1a51894c81533d3cb911f0bf2ff17797f24b9699cdf2cb4e955947b"}
Oct 30 18:36:46.883241 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.883180    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"6afdc1f67d73f43d135e8cebb9e8cce8acbc8c66a9a8b22a715d51621af8be00"}
Oct 30 18:36:46.886056 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.886031    2576 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="87299003c5005248b6a95dbe3f1a67fc468265daaaf87d7b795b3a4433991561" exitCode=0
Oct 30 18:36:46.886168 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:46.886063    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerDied","Data":"87299003c5005248b6a95dbe3f1a67fc468265daaaf87d7b795b3a4433991561"}
Oct 30 18:36:47.431669 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.431610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:47.431669 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.431673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:47.431872 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.431741    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:47.431872 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.431747    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:47.431872 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.431799    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:37:03.431783977 +0000 UTC m=+34.255238472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:36:47.431872 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.431812    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:37:03.431806129 +0000 UTC m=+34.255260624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:36:47.532174 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.532145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:47.532312 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.532287    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:36:47.532312 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.532305    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:36:47.532373 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.532315    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:47.532373 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.532359    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:03.532344166 +0000 UTC m=+34.355798679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:36:47.667532 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.667508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:47.667532 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.667535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:47.667685 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.667534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:47.667685 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.667612    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:47.667685 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.667673    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:47.667767 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:47.667748    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:47.892105 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.892078    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" event={"ID":"94271eb5-adea-4fe1-a166-baae2421784f","Type":"ContainerStarted","Data":"5a57bc322453adca61a369308151a86e761b0488c9801f995f9a6cdc4712c667"}
Oct 30 18:36:47.921236 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:47.921191    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mbn4h" podStartSLOduration=8.391477857 podStartE2EDuration="18.921175965s" totalImagesPullingTime="10.529698108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:47.920919188 +0000 UTC m=+18.744373705" watchObservedRunningTime="2026-10-30 18:36:47.921175965 +0000 UTC m=+18.744630482"
Oct 30 18:36:49.667976 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:49.667943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:49.668439 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:49.668402    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:49.668439 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:49.668428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:49.668577 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:49.668425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:49.668577 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:49.668549    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:49.668690 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:49.668614    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:49.899226 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:49.899203    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:36:49.899576 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:49.899556    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"c50804665e43bb842a8318af53184a668174b92f3c3f137b990822238fd0a8b0"}
Oct 30 18:36:51.668548 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.668379    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:51.669058 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.668439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:51.669058 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:51.668617    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:51.669058 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.668446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:51.669058 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:51.668711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:51.669058 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:51.668755    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:51.906518 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.906492    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:36:51.906891 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.906873    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"0167a63b25d5e61bacbe75e69ea3795435f48e08086919a749a0ef74d0c6824f"}
Oct 30 18:36:51.907220 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.907202    2576 scope.go:122] "RemoveContainer" containerID="5b83c9bbd1a51894c81533d3cb911f0bf2ff17797f24b9699cdf2cb4e955947b"
Oct 30 18:36:51.907277 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.907218    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:51.907277 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.907273    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:51.907385 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.907321    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:51.924995 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.924971    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:51.925261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:51.925247    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:36:52.913237 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.913217    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:36:52.913711 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.913598    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" event={"ID":"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2","Type":"ContainerStarted","Data":"68db1e75e6e4d12d29467eaf435ac872c04789484f5062e023e5d0a0f7d5a130"}
Oct 30 18:36:52.940833 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.940764    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gw4w2"]
Oct 30 18:36:52.940958 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.940885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:52.941013 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:52.940992    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:52.943947 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.943925    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mng5f"]
Oct 30 18:36:52.944048 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.944014    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:52.944115 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:52.944093    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:52.944743 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.944723    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mr8gw"]
Oct 30 18:36:52.944838 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.944824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:52.944934 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:52.944916    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:52.950762 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:52.950727    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d7958" podStartSLOduration=9.449983628 podStartE2EDuration="23.950717138s" totalImagesPullingTime="14.50073351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:52.94868863 +0000 UTC m=+23.772143145" watchObservedRunningTime="2026-10-30 18:36:52.950717138 +0000 UTC m=+23.774171648"
Oct 30 18:36:54.665804 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:54.665768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:54.666241 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:54.665860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:54.666241 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:54.665865    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:54.666241 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:54.665870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:54.666241 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:54.665937    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:54.666241 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:54.666037    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:55.162573 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:55.162547    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-778wz_ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2/dns-node-resolver/0.log"
Oct 30 18:36:56.332562 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:56.332501    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xmbq_4e6fda66-4524-4933-b497-2056bb7ed874/node-ca/0.log"
Oct 30 18:36:56.665149 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:56.665117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:56.665149 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:56.665141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:56.665365 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:56.665213    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:56.665365 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:56.665222    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:56.665365 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:56.665298    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:56.665469 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:56.665371    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:36:56.800756 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:56.800727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kj7ts_33d580e1-86c1-41a5-b0ed-3c846111d6b4/konnectivity-agent/0.log" limit=1024
Oct 30 18:36:57.062079 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:57.062006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kj7ts_33d580e1-86c1-41a5-b0ed-3c846111d6b4/konnectivity-agent/0.log" limit=1024
Oct 30 18:36:57.341041 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:57.341007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kj7ts_33d580e1-86c1-41a5-b0ed-3c846111d6b4/konnectivity-agent/0.log" limit=1024
Oct 30 18:36:58.665314 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:58.665282    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:36:58.665314 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:58.665302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:36:58.665844 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:36:58.665296    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:36:58.665844 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:58.665396    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:36:58.665844 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:58.665445    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:36:58.665844 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:36:58.665523    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:00.665430 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:00.665255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:00.665814 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:00.665257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:00.665814 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:00.665512    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:37:00.665814 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:00.665255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:00.665814 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:00.665576    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:37:00.665814 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:00.665634    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:02.665601 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:02.665566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:02.665601 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:02.665590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:02.666101 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:02.665566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:02.666101 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:02.665689    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:02.666101 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:02.665791    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:37:02.666101 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:02.665873    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:37:03.448481 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:03.448451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:03.448691 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:03.448501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:03.448691 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.448579    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:03.448691 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.448603    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:03.448691 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.448634    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs podName:3e958fd3-b9bf-455f-a339-39de790991ee nodeName:}" failed. No retries permitted until 2026-10-30 18:37:35.448619881 +0000 UTC m=+66.272074376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs") pod "network-metrics-daemon-mng5f" (UID: "3e958fd3-b9bf-455f-a339-39de790991ee") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 18:37:03.448691 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.448672    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret podName:72812209-4f7e-4e07-8b12-e2271ad4470f nodeName:}" failed. No retries permitted until 2026-10-30 18:37:35.448640377 +0000 UTC m=+66.272094874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret") pod "global-pull-secret-syncer-mr8gw" (UID: "72812209-4f7e-4e07-8b12-e2271ad4470f") : object "kube-system"/"original-pull-secret" not registered
Oct 30 18:37:03.549667 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:03.549627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:03.549801 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.549783    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 18:37:03.549841 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.549807    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 18:37:03.549841 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.549817    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jbfzz for pod openshift-network-diagnostics/network-check-target-gw4w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:03.549902 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:03.549856    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz podName:2cad6579-f0f3-43f5-b522-af8da26ad7b5 nodeName:}" failed. No retries permitted until 2026-10-30 18:37:35.549844984 +0000 UTC m=+66.373299505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbfzz" (UniqueName: "kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz") pod "network-check-target-gw4w2" (UID: "2cad6579-f0f3-43f5-b522-af8da26ad7b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 18:37:04.665405 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:04.665372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:04.665821 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:04.665440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:04.665821 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:04.665465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:04.665821 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:04.665545    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:04.665821 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:04.665583    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:37:04.665821 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:04.665682    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:37:06.665221 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:06.665190    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:06.665742 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:06.665189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:06.665742 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:06.665189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:06.665742 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:06.665417    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:37:06.665742 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:06.665290    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:06.665742 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:06.665474    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:37:08.665385 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:08.665351    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:08.665786 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:08.665392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:08.665786 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:08.665353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:08.665786 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:08.665463    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:37:08.665786 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:08.665540    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:37:08.665786 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:08.665597    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:10.665407 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:10.665375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:10.665793 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:10.665462    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mr8gw" podUID="72812209-4f7e-4e07-8b12-e2271ad4470f"
Oct 30 18:37:10.665793 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:10.665519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:10.665793 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:10.665618    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gw4w2" podUID="2cad6579-f0f3-43f5-b522-af8da26ad7b5"
Oct 30 18:37:10.665793 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:10.665699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:10.665910 ip-10-0-135-34 kubenswrapper[2576]: E1030 18:37:10.665792    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mng5f" podUID="3e958fd3-b9bf-455f-a339-39de790991ee"
Oct 30 18:37:12.476271 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.476209    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeReady"
Oct 30 18:37:12.476584 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.476312    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 18:37:12.573775 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.573747    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wphqb"]
Oct 30 18:37:12.576757 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.576740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.577284 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.577253    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6dqls"]
Oct 30 18:37:12.580476 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.580459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.584377 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.584355    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxh65\""
Oct 30 18:37:12.593407 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.593386    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 18:37:12.593621 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.593435    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 18:37:12.593621 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.593449    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 18:37:12.594265 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.594246    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wphqb"]
Oct 30 18:37:12.597878 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.597859    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6dqls"]
Oct 30 18:37:12.645329 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.645306    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kkds7"]
Oct 30 18:37:12.648128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.648114    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.665234 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.665207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:12.665311 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.665290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:12.665436 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.665420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:12.667566 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.667549    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kkds7"]
Oct 30 18:37:12.684953 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.684933    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 18:37:12.685155 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.685141    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r4rtj\""
Oct 30 18:37:12.685358 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.684936    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 18:37:12.686721 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686698    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 18:37:12.686805 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686727    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-829tl\""
Oct 30 18:37:12.686805 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686762    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-75g8c\""
Oct 30 18:37:12.686805 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686771    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2njn\""
Oct 30 18:37:12.686920 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686809    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-x9qkh\""
Oct 30 18:37:12.686920 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686848    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 18:37:12.686978 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.686926    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 18:37:12.694198 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.694175    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 18:37:12.694291 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.694256    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 18:37:12.694359 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.694342    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 18:37:12.695817 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.695803    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 18:37:12.695889 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.695825    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 18:37:12.716072 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.716042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/134db473-2a39-4577-861a-09778c502691-tmp-dir\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.716126 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.716088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/134db473-2a39-4577-861a-09778c502691-config-volume\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.716126 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.716117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b62lf\" (UniqueName: \"kubernetes.io/projected/134db473-2a39-4577-861a-09778c502691-kube-api-access-b62lf\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.716206 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.716191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q67r\" (UniqueName: \"kubernetes.io/projected/b74b9bd1-8acf-4839-9c82-84baf2e3b636-kube-api-access-2q67r\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.716279 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.716266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74b9bd1-8acf-4839-9c82-84baf2e3b636-cert\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.716321 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.716288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/134db473-2a39-4577-861a-09778c502691-metrics-tls\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.817418 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74b9bd1-8acf-4839-9c82-84baf2e3b636-cert\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.817418 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29e62d4-6063-432c-a721-e817f002b5a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.817551 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/134db473-2a39-4577-861a-09778c502691-metrics-tls\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.817551 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29e62d4-6063-432c-a721-e817f002b5a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.817697 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/134db473-2a39-4577-861a-09778c502691-tmp-dir\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.817756 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/134db473-2a39-4577-861a-09778c502691-config-volume\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.817813 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b62lf\" (UniqueName: \"kubernetes.io/projected/134db473-2a39-4577-861a-09778c502691-kube-api-access-b62lf\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.817813 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q67r\" (UniqueName: \"kubernetes.io/projected/b74b9bd1-8acf-4839-9c82-84baf2e3b636-kube-api-access-2q67r\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.817813 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29e62d4-6063-432c-a721-e817f002b5a2-crio-socket\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.817964 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29e62d4-6063-432c-a721-e817f002b5a2-data-volume\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.818019 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.817987    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/134db473-2a39-4577-861a-09778c502691-tmp-dir\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.818063 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.818033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg4ws\" (UniqueName: \"kubernetes.io/projected/f29e62d4-6063-432c-a721-e817f002b5a2-kube-api-access-rg4ws\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.818305 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.818284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/134db473-2a39-4577-861a-09778c502691-config-volume\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.821261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.821241    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/134db473-2a39-4577-861a-09778c502691-metrics-tls\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.821332 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.821288    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74b9bd1-8acf-4839-9c82-84baf2e3b636-cert\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.834451 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.834425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q67r\" (UniqueName: \"kubernetes.io/projected/b74b9bd1-8acf-4839-9c82-84baf2e3b636-kube-api-access-2q67r\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.834603 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.834584    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b62lf\" (UniqueName: \"kubernetes.io/projected/134db473-2a39-4577-861a-09778c502691-kube-api-access-b62lf\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.891484 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.891462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:12.894599 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.894583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:12.918531 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.918498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29e62d4-6063-432c-a721-e817f002b5a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.918531 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.918533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29e62d4-6063-432c-a721-e817f002b5a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.918770 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.918572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29e62d4-6063-432c-a721-e817f002b5a2-crio-socket\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.918770 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.918596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29e62d4-6063-432c-a721-e817f002b5a2-data-volume\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.918770 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.918621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg4ws\" (UniqueName: \"kubernetes.io/projected/f29e62d4-6063-432c-a721-e817f002b5a2-kube-api-access-rg4ws\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.918770 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.918760    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29e62d4-6063-432c-a721-e817f002b5a2-crio-socket\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.919054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.919036    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29e62d4-6063-432c-a721-e817f002b5a2-data-volume\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.919244 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.919224    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29e62d4-6063-432c-a721-e817f002b5a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.920954 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.920933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29e62d4-6063-432c-a721-e817f002b5a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.936363 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.936329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg4ws\" (UniqueName: \"kubernetes.io/projected/f29e62d4-6063-432c-a721-e817f002b5a2-kube-api-access-rg4ws\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:12.962138 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:12.962113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:13.193559 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.193533    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6dqls"]
Oct 30 18:37:13.197571 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:13.197546    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74b9bd1_8acf_4839_9c82_84baf2e3b636.slice/crio-09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996 WatchSource:0}: Error finding container 09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996: Status 404 returned error can't find the container with id 09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996
Oct 30 18:37:13.201859 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.200414    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wphqb"]
Oct 30 18:37:13.208994 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:13.208972    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134db473_2a39_4577_861a_09778c502691.slice/crio-55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8 WatchSource:0}: Error finding container 55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8: Status 404 returned error can't find the container with id 55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8
Oct 30 18:37:13.250873 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.250851    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kkds7"]
Oct 30 18:37:13.253912 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:13.253892    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29e62d4_6063_432c_a721_e817f002b5a2.slice/crio-9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144 WatchSource:0}: Error finding container 9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144: Status 404 returned error can't find the container with id 9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144
Oct 30 18:37:13.964244 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.964203    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkds7" event={"ID":"f29e62d4-6063-432c-a721-e817f002b5a2","Type":"ContainerStarted","Data":"12985722715bdb0c6e2f138259577b523f19b7a970fc61e70440ff3578fd6607"}
Oct 30 18:37:13.964734 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.964269    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkds7" event={"ID":"f29e62d4-6063-432c-a721-e817f002b5a2","Type":"ContainerStarted","Data":"9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144"}
Oct 30 18:37:13.967343 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.967281    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wphqb" event={"ID":"134db473-2a39-4577-861a-09778c502691","Type":"ContainerStarted","Data":"55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8"}
Oct 30 18:37:13.969036 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:13.969007    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6dqls" event={"ID":"b74b9bd1-8acf-4839-9c82-84baf2e3b636","Type":"ContainerStarted","Data":"09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996"}
Oct 30 18:37:14.148629 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.148600    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"]
Oct 30 18:37:14.151753 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.151732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.159806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.159783    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 18:37:14.161636 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.161615    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 18:37:14.161750 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.161647    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 18:37:14.161750 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.161724    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-58z5f\""
Oct 30 18:37:14.161750 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.161732    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 18:37:14.161894 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.161756    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 18:37:14.165310 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.165290    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"]
Oct 30 18:37:14.329118 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.329051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3201fe70-508e-4bba-8ad4-79a9f33a7df2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.329118 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.329104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.329282 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.329131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.329282 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.329151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz6bn\" (UniqueName: \"kubernetes.io/projected/3201fe70-508e-4bba-8ad4-79a9f33a7df2-kube-api-access-rz6bn\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.430312 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.429546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3201fe70-508e-4bba-8ad4-79a9f33a7df2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.430312 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.429608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.430312 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.429672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.430312 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.429703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6bn\" (UniqueName: \"kubernetes.io/projected/3201fe70-508e-4bba-8ad4-79a9f33a7df2-kube-api-access-rz6bn\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.430587 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.430341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3201fe70-508e-4bba-8ad4-79a9f33a7df2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.432951 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.432924    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.433074 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.432925    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.443972 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.443947    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6bn\" (UniqueName: \"kubernetes.io/projected/3201fe70-508e-4bba-8ad4-79a9f33a7df2-kube-api-access-rz6bn\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.467822 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.467799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:14.756850 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.756763    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"]
Oct 30 18:37:14.762701 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:14.762646    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3201fe70_508e_4bba_8ad4_79a9f33a7df2.slice/crio-df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4 WatchSource:0}: Error finding container df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4: Status 404 returned error can't find the container with id df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4
Oct 30 18:37:14.975920 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.975881    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkds7" event={"ID":"f29e62d4-6063-432c-a721-e817f002b5a2","Type":"ContainerStarted","Data":"870af1cd4f27329f04c76a0ee67925af3e405c0363555eb6b0c35cd1ad51eb43"}
Oct 30 18:37:14.977164 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:14.977121    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf" event={"ID":"3201fe70-508e-4bba-8ad4-79a9f33a7df2","Type":"ContainerStarted","Data":"df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4"}
Oct 30 18:37:15.982848 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:15.982549    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wphqb" event={"ID":"134db473-2a39-4577-861a-09778c502691","Type":"ContainerStarted","Data":"a07cc9610c6aa9875d46ec376a85df5e946928f160a7159324081d9a70e47821"}
Oct 30 18:37:15.982848 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:15.982625    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wphqb" event={"ID":"134db473-2a39-4577-861a-09778c502691","Type":"ContainerStarted","Data":"9c62090fa42a3ca0800cfcbc52332766bf59850c3e782e61733619b2549e31cb"}
Oct 30 18:37:15.982848 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:15.982674    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:15.985390 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:15.985366    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkds7" event={"ID":"f29e62d4-6063-432c-a721-e817f002b5a2","Type":"ContainerStarted","Data":"6cb4fd7ce62a5819608da6ab4e6457f97e5c9b545c2df66e500398c051258dbc"}
Oct 30 18:37:16.005179 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:16.005129    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-wphqb" podStartSLOduration=1.8445680819999999 podStartE2EDuration="4.005114297s" totalImagesPullingTime="2.160546215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:16.004305596 +0000 UTC m=+46.827760114" watchObservedRunningTime="2026-10-30 18:37:16.005114297 +0000 UTC m=+46.828568814"
Oct 30 18:37:16.034954 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:16.034877    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kkds7" podStartSLOduration=1.639461517 podStartE2EDuration="4.034865884s" totalImagesPullingTime="2.395404367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:16.034071952 +0000 UTC m=+46.857526469" watchObservedRunningTime="2026-10-30 18:37:16.034865884 +0000 UTC m=+46.858320400"
Oct 30 18:37:16.989444 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:16.989404    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6dqls" event={"ID":"b74b9bd1-8acf-4839-9c82-84baf2e3b636","Type":"ContainerStarted","Data":"a1dbcd425fadad03090aa2fa81a1f5d9f0f43d477455d3d818223889c10334b2"}
Oct 30 18:37:16.991340 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:16.991306    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf" event={"ID":"3201fe70-508e-4bba-8ad4-79a9f33a7df2","Type":"ContainerStarted","Data":"ae1ed1230d4c1b065d47e176b23b5a5f203be46aa1f9bcb9f20c91e5e3ee6e41"}
Oct 30 18:37:16.991471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:16.991367    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf" event={"ID":"3201fe70-508e-4bba-8ad4-79a9f33a7df2","Type":"ContainerStarted","Data":"97d43bf008a117f033a39617d2b75e4e6dc9bf0a5b8f1be282547368793eff6b"}
Oct 30 18:37:17.019750 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.019699    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6dqls" podStartSLOduration=2.053015499 podStartE2EDuration="5.019686638s" totalImagesPullingTime="2.966671139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:17.018620515 +0000 UTC m=+47.842075030" watchObservedRunningTime="2026-10-30 18:37:17.019686638 +0000 UTC m=+47.843141153"
Oct 30 18:37:17.045106 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.045054    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf" podStartSLOduration=1.6088976499999998 podStartE2EDuration="3.045034965s" totalImagesPullingTime="1.436137315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:17.044409896 +0000 UTC m=+47.867864416" watchObservedRunningTime="2026-10-30 18:37:17.045034965 +0000 UTC m=+47.868489482"
Oct 30 18:37:17.405722 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.405689    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-556db5d9b4-9fjwk"]
Oct 30 18:37:17.408769 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.408752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.418964 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.418935    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 18:37:17.418964 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.418953    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 18:37:17.419096 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.418966    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 18:37:17.419096 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.419011    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 18:37:17.419096 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.419055    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 18:37:17.419233 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.419101    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 18:37:17.419277 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.419246    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ntkxb\""
Oct 30 18:37:17.419441 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.419424    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 18:37:17.422824 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.422798    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556db5d9b4-9fjwk"]
Oct 30 18:37:17.553365 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.553486 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.553486 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.553486 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.553600 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.553600 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.553685 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.553627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654574 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654687 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654687 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654687 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654687 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654938 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.654938 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.654847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.655266 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.655242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.655518 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.655328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.655518 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.655333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.655518 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.655504    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.657266 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.657216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.657266 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.657226    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.668135 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.668115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:17.726716 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:17.726686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:18.014087 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.013999    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556db5d9b4-9fjwk"]
Oct 30 18:37:18.017783 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:18.017755    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986df46a_1438_4ec9_a665_9093589b136f.slice/crio-9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b WatchSource:0}: Error finding container 9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b: Status 404 returned error can't find the container with id 9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b
Oct 30 18:37:18.807133 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.807094    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"]
Oct 30 18:37:18.810511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.810482    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"]
Oct 30 18:37:18.810644 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.810602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:18.814579 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.814558    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.822730 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.822707    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5jr2c\""
Oct 30 18:37:18.826975 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.826953    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 18:37:18.829471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.828221    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tjg84"]
Oct 30 18:37:18.829471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.828503    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ts4zm\""
Oct 30 18:37:18.829471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.828883    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:37:18.829471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.828911    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 18:37:18.829471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.828959    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 18:37:18.829471 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.828966    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:37:18.833397 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.832582    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"]
Oct 30 18:37:18.833397 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.832631    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"]
Oct 30 18:37:18.833397 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.832742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.928680 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.928643    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 18:37:18.928896 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.928797    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 18:37:18.928896 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.928826    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vs59c\""
Oct 30 18:37:18.928896 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.928832    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 18:37:18.966829 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.966802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.966960 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.966838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-sys\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.966960 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.966859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j29wt\" (UniqueName: \"kubernetes.io/projected/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-api-access-j29wt\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.966960 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.966889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.967113 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.966962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-textfile\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967113 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.967113 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967251 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.967251 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:18.967251 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-wtmp\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967251 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967251 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g77m\" (UniqueName: \"kubernetes.io/projected/2bb1395d-e068-4d07-a218-971ffb972271-kube-api-access-9g77m\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967251 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-metrics-client-ca\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967439 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-root\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967439 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmljb\" (UniqueName: \"kubernetes.io/projected/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-kube-api-access-fmljb\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:18.967439 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-tls\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:18.967439 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:18.967439 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:18.967586 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.967481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:18.999469 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:18.999435    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556db5d9b4-9fjwk" event={"ID":"986df46a-1438-4ec9-a665-9093589b136f","Type":"ContainerStarted","Data":"9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b"}
Oct 30 18:37:19.068094 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.068094 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-wtmp\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g77m\" (UniqueName: \"kubernetes.io/projected/2bb1395d-e068-4d07-a218-971ffb972271-kube-api-access-9g77m\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-metrics-client-ca\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-root\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmljb\" (UniqueName: \"kubernetes.io/projected/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-kube-api-access-fmljb\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-tls\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-sys\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j29wt\" (UniqueName: \"kubernetes.io/projected/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-api-access-j29wt\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-textfile\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.068550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.069184 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.069184 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.068593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.069184 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.069047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-wtmp\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.069184 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.069138    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-root\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.069323 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.069196    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-sys\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.070179 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.070141    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.070179 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.070149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-metrics-client-ca\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.070896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.071305    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.071558    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-textfile\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.072289    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.072604    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.072881    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.073171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.073601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.078717    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.080701 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.078804    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.081210 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.080954    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-tls\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.082330 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.082015    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmljb\" (UniqueName: \"kubernetes.io/projected/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-kube-api-access-fmljb\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.083209 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.083191    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g77m\" (UniqueName: \"kubernetes.io/projected/2bb1395d-e068-4d07-a218-971ffb972271-kube-api-access-9g77m\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.084569 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.084543    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29wt\" (UniqueName: \"kubernetes.io/projected/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-api-access-j29wt\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.129352 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.129310    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:19.138448 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.138426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:19.149799 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.149767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:19.168972 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:19.168941    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb1395d_e068_4d07_a218_971ffb972271.slice/crio-1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843 WatchSource:0}: Error finding container 1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843: Status 404 returned error can't find the container with id 1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843
Oct 30 18:37:19.421905 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.421870    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"]
Oct 30 18:37:19.425047 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:19.425021    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a96c523_b3c5_49e5_b785_d6bb59ac17ef.slice/crio-bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6 WatchSource:0}: Error finding container bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6: Status 404 returned error can't find the container with id bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6
Oct 30 18:37:19.434821 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:19.434794    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"]
Oct 30 18:37:19.438531 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:19.438503    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6242e1_e200_4ca0_be72_7eb7a46e8ee0.slice/crio-40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235 WatchSource:0}: Error finding container 40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235: Status 404 returned error can't find the container with id 40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235
Oct 30 18:37:20.008720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.008601    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj" event={"ID":"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0","Type":"ContainerStarted","Data":"40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235"}
Oct 30 18:37:20.011032 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.011000    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf" event={"ID":"9a96c523-b3c5-49e5-b785-d6bb59ac17ef","Type":"ContainerStarted","Data":"531372bdc1489d648969ca7a0335329f47c52a241335fc62965f98b7dbc44626"}
Oct 30 18:37:20.011152 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.011054    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf" event={"ID":"9a96c523-b3c5-49e5-b785-d6bb59ac17ef","Type":"ContainerStarted","Data":"aa230b9fdd527cc83ef810cf3eb850b5e94467bb0152fb5434043b5264706fad"}
Oct 30 18:37:20.011152 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.011076    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf" event={"ID":"9a96c523-b3c5-49e5-b785-d6bb59ac17ef","Type":"ContainerStarted","Data":"bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6"}
Oct 30 18:37:20.013277 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.013202    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjg84" event={"ID":"2bb1395d-e068-4d07-a218-971ffb972271","Type":"ContainerStarted","Data":"1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843"}
Oct 30 18:37:20.097897 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.097624    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:37:20.115388 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.115355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.122719 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.122696    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 18:37:20.122842 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.122746    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 18:37:20.122842 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.122827    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gmwpq\""
Oct 30 18:37:20.123425 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.123403    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 18:37:20.129824 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.129799    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:37:20.132353 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.132319    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 18:37:20.167337 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.167316    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 18:37:20.167337 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.167333    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 18:37:20.167635 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.167550    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 18:37:20.167804 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.167788    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 18:37:20.168133 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.168092    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.277720 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.278121 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.278121 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.278121 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.278121 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.277943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.378684 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.378808 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.378808 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.378912 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.378912 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.378912 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.378970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.379001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.379029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379244 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.379056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379244 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.379084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379244 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.379108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.379960 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.379934    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.380275 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.380252    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.383432 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.382364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.383432 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.383376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.384931 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.384678    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.384931 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.384880    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.385159 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.385116    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.385550 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.385517    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.386237 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.386211    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.386237 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.386234    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.390021 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.388082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.390021 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.388478    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.398758 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.398737    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.448887 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.448856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:20.807313 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:20.807285    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:37:20.807815 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:20.807788    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ac92f9_c17a_4920_9919_1ac0263481e5.slice/crio-f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c WatchSource:0}: Error finding container f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c: Status 404 returned error can't find the container with id f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c
Oct 30 18:37:21.018941 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.018917    2576 generic.go:356] "Generic (PLEG): container finished" podID="2bb1395d-e068-4d07-a218-971ffb972271" containerID="e18711817190c1d46698870b7b30abec89f0d069520b504c5dbb8e67a4a8de6d" exitCode=0
Oct 30 18:37:21.019062 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.018956    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjg84" event={"ID":"2bb1395d-e068-4d07-a218-971ffb972271","Type":"ContainerDied","Data":"e18711817190c1d46698870b7b30abec89f0d069520b504c5dbb8e67a4a8de6d"}
Oct 30 18:37:21.020398 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.020373    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c"}
Oct 30 18:37:21.023608 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.023583    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf" event={"ID":"9a96c523-b3c5-49e5-b785-d6bb59ac17ef","Type":"ContainerStarted","Data":"9b8019ace22a58a1b0e8e8132950a081684b9d3fefb4fbf6e5ec8491f5706cfc"}
Oct 30 18:37:21.095252 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.093667    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"]
Oct 30 18:37:21.096115 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.096069    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf" podStartSLOduration=1.91534496 podStartE2EDuration="3.096049617s" totalImagesPullingTime="1.180704657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:21.092821318 +0000 UTC m=+51.916275836" watchObservedRunningTime="2026-10-30 18:37:21.096049617 +0000 UTC m=+51.919504148"
Oct 30 18:37:21.099686 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.098708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.116219 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.116195    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 18:37:21.116285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.116251    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 18:37:21.116325 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.116286    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 18:37:21.116369 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.116358    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 18:37:21.117931 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.117912    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"]
Oct 30 18:37:21.118132 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.118117    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bbfb8bpjur100\""
Oct 30 18:37:21.118223 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.118210    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dshdk\""
Oct 30 18:37:21.214284 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.214211    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 18:37:21.286449 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-grpc-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286558 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286558 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286697 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7150c1a0-ddc4-458e-939b-25e28b3a0496-metrics-client-ca\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286697 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286793 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vnv\" (UniqueName: \"kubernetes.io/projected/7150c1a0-ddc4-458e-939b-25e28b3a0496-kube-api-access-j5vnv\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286793 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286793 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7150c1a0-ddc4-458e-939b-25e28b3a0496-tmp\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.286793 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.286785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388103 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-grpc-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388253 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388253 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388253 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7150c1a0-ddc4-458e-939b-25e28b3a0496-metrics-client-ca\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388417 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388417 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vnv\" (UniqueName: \"kubernetes.io/projected/7150c1a0-ddc4-458e-939b-25e28b3a0496-kube-api-access-j5vnv\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388417 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388417 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7150c1a0-ddc4-458e-939b-25e28b3a0496-tmp\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388602 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.388872 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.388850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7150c1a0-ddc4-458e-939b-25e28b3a0496-tmp\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.389114 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.389091    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7150c1a0-ddc4-458e-939b-25e28b3a0496-metrics-client-ca\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.392086 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.392065    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.392450 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.392428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.392579 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.392553    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.393066 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.393033    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.393153 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.393113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-grpc-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.393725 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.393706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.405875 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.405843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vnv\" (UniqueName: \"kubernetes.io/projected/7150c1a0-ddc4-458e-939b-25e28b3a0496-kube-api-access-j5vnv\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.438814 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.438588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:21.735725 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:21.735690    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"]
Oct 30 18:37:21.742065 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:21.742036    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7150c1a0_ddc4_458e_939b_25e28b3a0496.slice/crio-8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303 WatchSource:0}: Error finding container 8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303: Status 404 returned error can't find the container with id 8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303
Oct 30 18:37:22.027819 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.027744    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303"}
Oct 30 18:37:22.029797 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.029769    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj" event={"ID":"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0","Type":"ContainerStarted","Data":"27aa85efb18f0a63e5ea6cb3cc59efe2f834e078f2c743166dc82f27d3ec2eda"}
Oct 30 18:37:22.029905 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.029825    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj" event={"ID":"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0","Type":"ContainerStarted","Data":"540a8bd4d0f23660d9eee39fbca1bfab5c9378f2098cf227bad20fbe8b864753"}
Oct 30 18:37:22.029905 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.029855    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj" event={"ID":"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0","Type":"ContainerStarted","Data":"26a10f01b602948762c968cc57249f22c007c060a0bf5ddf23f8412402ac8eab"}
Oct 30 18:37:22.032062 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.032036    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjg84" event={"ID":"2bb1395d-e068-4d07-a218-971ffb972271","Type":"ContainerStarted","Data":"39d396c48ee23341b8c8d4225219078bccba102e61ed521b04830b1ea77bfd0d"}
Oct 30 18:37:22.032147 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.032096    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjg84" event={"ID":"2bb1395d-e068-4d07-a218-971ffb972271","Type":"ContainerStarted","Data":"035796fc1b40ed77b9280888e0ca41a698b9a80c33787b9c71ded469ebaf0c49"}
Oct 30 18:37:22.033501 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.033480    2576 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0" exitCode=0
Oct 30 18:37:22.033581 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.033523    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0"}
Oct 30 18:37:22.035309 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.035265    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556db5d9b4-9fjwk" event={"ID":"986df46a-1438-4ec9-a665-9093589b136f","Type":"ContainerStarted","Data":"8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb"}
Oct 30 18:37:22.110190 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.110149    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj" podStartSLOduration=2.5731063990000003 podStartE2EDuration="4.110136271s" totalImagesPullingTime="1.537029872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:22.060782757 +0000 UTC m=+52.884237272" watchObservedRunningTime="2026-10-30 18:37:22.110136271 +0000 UTC m=+52.933590787"
Oct 30 18:37:22.168873 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.168834    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tjg84" podStartSLOduration=2.967195238 podStartE2EDuration="4.168822052s" totalImagesPullingTime="1.106308491s" totalInitContainerRuntime="95.318323ms" isStatefulPod=true podCreationTimestamp="2026-10-30 18:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:22.16801165 +0000 UTC m=+52.991466166" watchObservedRunningTime="2026-10-30 18:37:22.168822052 +0000 UTC m=+52.992276567"
Oct 30 18:37:22.195374 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.195323    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-556db5d9b4-9fjwk" podStartSLOduration=1.9425751930000001 podStartE2EDuration="5.195310928s" totalImagesPullingTime="3.252735735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:22.194236797 +0000 UTC m=+53.017691313" watchObservedRunningTime="2026-10-30 18:37:22.195310928 +0000 UTC m=+53.018765443"
Oct 30 18:37:22.462807 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.462771    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cdff48494-95kkl"]
Oct 30 18:37:22.466062 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.466030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.489107 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.489080    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 18:37:22.491041 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.491017    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdff48494-95kkl"]
Oct 30 18:37:22.599041 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.598976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599193 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599193 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599193 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599193 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599426 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599426 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.599426 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.599237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700475 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700475 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700475 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700475 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700475 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.700475 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.700438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.701117 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.701092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.702510 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.702042    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.702510 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.702451    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.702510 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.702474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.702748 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.702607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.704167 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.704143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.705283 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.705260    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.718297 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.718231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:22.781097 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:22.781071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:23.077831 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.076640    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdff48494-95kkl"]
Oct 30 18:37:23.081140 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:23.081110    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02247e5_ec62_447f_906d_8a475609d158.slice/crio-a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628 WatchSource:0}: Error finding container a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628: Status 404 returned error can't find the container with id a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628
Oct 30 18:37:23.323818 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.323785    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64bc79665d-fthpb"]
Oct 30 18:37:23.327441 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.327418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.337481 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.337429    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 18:37:23.339554 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.339533    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 18:37:23.339646 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.339538    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 18:37:23.339646 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.339607    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zz6bl\""
Oct 30 18:37:23.339646 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.339631    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3gji7s0vk8526\""
Oct 30 18:37:23.339847 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.339722    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 18:37:23.347827 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.347801    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64bc79665d-fthpb"]
Oct 30 18:37:23.414237 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-metrics-server-audit-profiles\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.414410 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29nn2\" (UniqueName: \"kubernetes.io/projected/07aedb61-c8c3-48b2-9a23-98fbc418c394-kube-api-access-29nn2\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.414410 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-client-certs\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.414826 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-tls\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.414826 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.414826 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-client-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.414826 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.414550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07aedb61-c8c3-48b2-9a23-98fbc418c394-audit-log\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515384 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-client-certs\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515509 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-tls\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515591 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515646 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-client-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515726 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07aedb61-c8c3-48b2-9a23-98fbc418c394-audit-log\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515788 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-metrics-server-audit-profiles\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.515788 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.515762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29nn2\" (UniqueName: \"kubernetes.io/projected/07aedb61-c8c3-48b2-9a23-98fbc418c394-kube-api-access-29nn2\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.516380 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.516352    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07aedb61-c8c3-48b2-9a23-98fbc418c394-audit-log\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.517051 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.517026    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.517163 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.517048    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-metrics-server-audit-profiles\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.518158 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.518137    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-tls\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.518325 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.518301    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-client-certs\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.518482 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.518456    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-client-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.530712 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.530693    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29nn2\" (UniqueName: \"kubernetes.io/projected/07aedb61-c8c3-48b2-9a23-98fbc418c394-kube-api-access-29nn2\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.642641 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.642621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:23.925618 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.925593    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:23.930618 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:23.930600    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64bc79665d-fthpb"]
Oct 30 18:37:23.933689 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:23.933632    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07aedb61_c8c3_48b2_9a23_98fbc418c394.slice/crio-299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767 WatchSource:0}: Error finding container 299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767: Status 404 returned error can't find the container with id 299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767
Oct 30 18:37:24.043945 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.043913    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdff48494-95kkl" event={"ID":"a02247e5-ec62-447f-906d-8a475609d158","Type":"ContainerStarted","Data":"ed0d6a7add1ebc22eea9d7a3c91640a9aaabcb8c849129a88683e5a6098d03bf"}
Oct 30 18:37:24.044047 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.043989    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdff48494-95kkl" event={"ID":"a02247e5-ec62-447f-906d-8a475609d158","Type":"ContainerStarted","Data":"a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628"}
Oct 30 18:37:24.047025 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.047004    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5"}
Oct 30 18:37:24.047298 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.047053    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3"}
Oct 30 18:37:24.047298 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.047086    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a"}
Oct 30 18:37:24.047298 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.047121    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941"}
Oct 30 18:37:24.047298 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.047152    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c"}
Oct 30 18:37:24.048241 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.048207    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64bc79665d-fthpb" event={"ID":"07aedb61-c8c3-48b2-9a23-98fbc418c394","Type":"ContainerStarted","Data":"299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767"}
Oct 30 18:37:24.050312 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.050289    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"a6c75425e8b826f722353c8021bd3e6e44295fda180e4548d0f83d3d27da3e5b"}
Oct 30 18:37:24.050412 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.050352    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"155d3e0fc3675603b54048bfc859644028926542f07918d763c269c772f517e2"}
Oct 30 18:37:24.050412 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.050394    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"83532e6d65995766301041ee264a0cd29b5f8892c5cd21062e6b19d33658f425"}
Oct 30 18:37:24.076877 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:24.076823    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7cdff48494-95kkl" podStartSLOduration=2.076811273 podStartE2EDuration="2.076811273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:24.076092998 +0000 UTC m=+54.899547514" watchObservedRunningTime="2026-10-30 18:37:24.076811273 +0000 UTC m=+54.900265842"
Oct 30 18:37:25.061503 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.060765    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerStarted","Data":"c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009"}
Oct 30 18:37:25.064403 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.064369    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"e1d2558e5d98820729af0e4565636c94acd9162a07645f31bf75bb7d73599560"}
Oct 30 18:37:25.064547 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.064435    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"47b08949ce2c33dcf3ccd82e272d7c3263bca1abc1af32eca1d6172e48c14217"}
Oct 30 18:37:25.064547 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.064461    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" event={"ID":"7150c1a0-ddc4-458e-939b-25e28b3a0496","Type":"ContainerStarted","Data":"157d19434dbc7e2cc7da6b9ebeb8eb3022074cf1633163e32e927941273d1f31"}
Oct 30 18:37:25.103348 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.103113    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.846544666 podStartE2EDuration="5.103094391s" totalImagesPullingTime="3.245920668s" totalInitContainerRuntime="10.629057ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:25.101955036 +0000 UTC m=+55.925409551" watchObservedRunningTime="2026-10-30 18:37:25.103094391 +0000 UTC m=+55.926548908"
Oct 30 18:37:25.271295 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.271236    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq" podStartSLOduration=1.580126412 podStartE2EDuration="4.271219021s" totalImagesPullingTime="2.691092609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:25.134486097 +0000 UTC m=+55.957940614" watchObservedRunningTime="2026-10-30 18:37:25.271219021 +0000 UTC m=+56.094673603"
Oct 30 18:37:25.272306 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.272279    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:37:25.276453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.276430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.281896 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.281854    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 18:37:25.282005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.281894    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 18:37:25.282005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.281914    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 18:37:25.282596 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.282574    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 18:37:25.282733 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.282685    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 18:37:25.282790 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.282765    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 18:37:25.283054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.283031    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 18:37:25.283627 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.283448    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kfsqx\""
Oct 30 18:37:25.283627 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.283596    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 18:37:25.283808 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.283628    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 18:37:25.289110 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.289090    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 18:37:25.293381 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.293359    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 18:37:25.293381 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.293390    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 18:37:25.293801 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.293780    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0huhn2rtoft9\""
Oct 30 18:37:25.293958 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.293945    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 18:37:25.294007 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.293958    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 18:37:25.305285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.305261    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:37:25.335128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335248 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335248 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335248 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335248 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335453 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.335806 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.335685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436317 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436317 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436511 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436874 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436874 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436874 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.436874 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437060 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437060 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437060 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437060 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437060 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.436996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437060 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.437033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437344 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.437117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.437933 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.437893    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.438375 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.438202    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.438507 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.438479    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.439197 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.439170    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.439324 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.438024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443242 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.441428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443242 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.442089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443242 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.443076    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443417 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.443295    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443470 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.443428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443935 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.443844    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.443935 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.443849    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.444968 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.444948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.445600 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.445483    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.445702 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.445626    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.445756 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.445694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.445917 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.445892    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.447074 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.447052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.447276 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.447257    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.456636 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.456614    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.626975 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.626935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:25.931252 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.931175    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:37:25.933917 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:25.933887    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ac2bd3_795e_46f0_b689_7bac9ddc3ed1.slice/crio-d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5 WatchSource:0}: Error finding container d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5: Status 404 returned error can't find the container with id d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5
Oct 30 18:37:25.994190 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:25.994169    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:26.069677 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:26.069617    2576 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf" exitCode=0
Oct 30 18:37:26.070013 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:26.069690    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf"}
Oct 30 18:37:26.070013 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:26.069764    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5"}
Oct 30 18:37:26.071508 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:26.071480    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64bc79665d-fthpb" event={"ID":"07aedb61-c8c3-48b2-9a23-98fbc418c394","Type":"ContainerStarted","Data":"446ead649862681c42e7a6392b8e3e951fdb0d22c723cde5d2c4d54f44ccd9b5"}
Oct 30 18:37:26.072177 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:26.072160    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:26.126034 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:26.125994    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64bc79665d-fthpb" podStartSLOduration=1.74953392 podStartE2EDuration="3.125973867s" totalImagesPullingTime="1.376439947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:26.124768281 +0000 UTC m=+56.948222796" watchObservedRunningTime="2026-10-30 18:37:26.125973867 +0000 UTC m=+56.949428382"
Oct 30 18:37:27.726855 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:27.726820    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:27.727250 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:27.726882    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:27.732360 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:27.732339    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:28.089250 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:28.089221    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:29.090870 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:29.090838    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1"}
Oct 30 18:37:29.091246 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:29.090911    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0"}
Oct 30 18:37:30.098887 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:30.098854    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85"}
Oct 30 18:37:30.099261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:30.098916    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf"}
Oct 30 18:37:30.099261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:30.098940    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb"}
Oct 30 18:37:30.099261 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:30.098966    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerStarted","Data":"3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828"}
Oct 30 18:37:30.140401 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:30.140350    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.278887654 podStartE2EDuration="5.140335886s" totalImagesPullingTime="2.844430688s" totalInitContainerRuntime="17.017544ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:30.13964368 +0000 UTC m=+60.963098198" watchObservedRunningTime="2026-10-30 18:37:30.140335886 +0000 UTC m=+60.963790401"
Oct 30 18:37:30.627573 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:30.627543    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:31.638218 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.638178    2576 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdff48494-95kkl"]
Oct 30 18:37:31.680372 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.680341    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7cd7686f-fzssr"]
Oct 30 18:37:31.684902 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.684885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.745242 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.745211    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7cd7686f-fzssr"]
Oct 30 18:37:31.801128 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801243 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801243 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801315 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801315 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801315 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801415 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.801462 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.801417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902120 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902120 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902285 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902795 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902763    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.902895 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.902874    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.903217 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.903192    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.903284 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.903218    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.903425 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.903408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.904815 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.904788    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.904944 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.904919    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.915593 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.915567    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:31.996402 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:31.996377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:32.086799 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:32.086777    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:32.276263 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:32.276200    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7cd7686f-fzssr"]
Oct 30 18:37:32.279481 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:32.279447    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae624ce9_fe64_4cb8_a053_4ccf2dabbd9c.slice/crio-e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4 WatchSource:0}: Error finding container e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4: Status 404 returned error can't find the container with id e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4
Oct 30 18:37:32.782342 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:32.782300    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:33.113765 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:33.113733    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7cd7686f-fzssr" event={"ID":"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c","Type":"ContainerStarted","Data":"ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16"}
Oct 30 18:37:33.113915 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:33.113782    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7cd7686f-fzssr" event={"ID":"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c","Type":"ContainerStarted","Data":"e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4"}
Oct 30 18:37:33.154098 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:33.154050    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6b7cd7686f-fzssr" podStartSLOduration=2.154035997 podStartE2EDuration="2.154035997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:33.153218741 +0000 UTC m=+63.976673256" watchObservedRunningTime="2026-10-30 18:37:33.154035997 +0000 UTC m=+63.977490513"
Oct 30 18:37:35.532485 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.532452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:35.532894 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.532520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:35.538386 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.538364    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 18:37:35.538386 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.538378    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 18:37:35.546061 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.546037    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:35.546061 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.546052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:35.633671 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.633631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:35.637054 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.637038    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 18:37:35.647374 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.647359    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 18:37:35.656707 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.656688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:35.779527 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.779507    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-829tl\""
Oct 30 18:37:35.786708 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.786667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:35.788926 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.788911    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2njn\""
Oct 30 18:37:35.792229 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.792213    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-75g8c\""
Oct 30 18:37:35.796381 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.796362    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:35.799716 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:35.799692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:36.080778 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:36.080755    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gw4w2"]
Oct 30 18:37:36.083252 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:36.083227    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cad6579_f0f3_43f5_b522_af8da26ad7b5.slice/crio-c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858 WatchSource:0}: Error finding container c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858: Status 404 returned error can't find the container with id c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858
Oct 30 18:37:36.132586 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:36.132560    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mr8gw"]
Oct 30 18:37:36.133491 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:36.133452    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72812209_4f7e_4e07_8b12_e2271ad4470f.slice/crio-3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e WatchSource:0}: Error finding container 3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e: Status 404 returned error can't find the container with id 3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e
Oct 30 18:37:36.134005 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:36.133952    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gw4w2" event={"ID":"2cad6579-f0f3-43f5-b522-af8da26ad7b5","Type":"ContainerStarted","Data":"c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858"}
Oct 30 18:37:36.134267 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:36.134246    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mng5f"]
Oct 30 18:37:36.134364 ip-10-0-135-34 kubenswrapper[2576]: W1030 18:37:36.134307    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e958fd3_b9bf_455f_a339_39de790991ee.slice/crio-bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308 WatchSource:0}: Error finding container bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308: Status 404 returned error can't find the container with id bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308
Oct 30 18:37:37.141068 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:37.141034    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mr8gw" event={"ID":"72812209-4f7e-4e07-8b12-e2271ad4470f","Type":"ContainerStarted","Data":"3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e"}
Oct 30 18:37:37.144139 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:37.144109    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mng5f" event={"ID":"3e958fd3-b9bf-455f-a339-39de790991ee","Type":"ContainerStarted","Data":"bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308"}
Oct 30 18:37:38.151684 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:38.151379    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mng5f" event={"ID":"3e958fd3-b9bf-455f-a339-39de790991ee","Type":"ContainerStarted","Data":"1da5ac2c90ddb6d11b14d23a61c8da97a66c567a214e5b01fc4e53aeab35bd3b"}
Oct 30 18:37:38.151684 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:38.151445    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mng5f" event={"ID":"3e958fd3-b9bf-455f-a339-39de790991ee","Type":"ContainerStarted","Data":"03322cf2a9302a738b49136a0a1c827ad98762638617d4f41b930f1ba5255caa"}
Oct 30 18:37:38.178411 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:38.178342    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mng5f" podStartSLOduration=68.044649546 podStartE2EDuration="1m9.178328437s" totalImagesPullingTime="1.133678891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:38.176333144 +0000 UTC m=+68.999787671" watchObservedRunningTime="2026-10-30 18:37:38.178328437 +0000 UTC m=+69.001782953"
Oct 30 18:37:40.162952 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:40.162910    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gw4w2" event={"ID":"2cad6579-f0f3-43f5-b522-af8da26ad7b5","Type":"ContainerStarted","Data":"41a06b17e80e028570ee0416231de239b13cc472e2e53c9e54f649b8b9bde292"}
Oct 30 18:37:40.163432 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:40.163033    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:40.197230 ip-10-0-135-34 kubenswrapper[2576]: I1030 18:37:40.197177    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gw4w2" podStartSLOduration=67.909334109 podStartE2EDuration="1m11.197158775s" totalImagesPullingTime="3.287824666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:40.194912825 +0000 UTC m=+71.018367341" watchObservedRunningTime="2026-10-30 18:37:40.197158775 +0000 UTC m=+71.020613292"
Oct 30 18:37:41.065541 ip-10-0-135-34 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 18:37:41.077138 ip-10-0-135-34 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 18:37:41.077366 ip-10-0-135-34 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 18:37:41.077424 ip-10-0-135-34 systemd[1]: kubelet.service: Consumed 4.544s CPU time.
Oct 30 18:37:41.088310 ip-10-0-135-34 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 18:37:41.151919 ip-10-0-135-34 kubenswrapper[6064]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:37:41.152502 ip-10-0-135-34 kubenswrapper[6064]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 18:37:41.152502 ip-10-0-135-34 kubenswrapper[6064]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:37:41.152608 ip-10-0-135-34 kubenswrapper[6064]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 18:37:41.154571 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154496    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.154571 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154569    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.154571 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154574    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154578    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154582    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154586    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154590    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154594    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154597    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154601    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154605    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154610    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154613    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154619    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154623    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154627    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154631    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154636    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154640    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154644    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154648    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154671    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.154795 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154676    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154680    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154684    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154688    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154692    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154696    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154711    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154715    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154720    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154727    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154733    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154738    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154743    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154747    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154751    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154755    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154759    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154764    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154768    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154773    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.155647 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154777    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154781    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154786    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154790    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154796    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154803    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154809    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154813    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154817    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154821    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154825    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154830    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154835    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154839    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154845    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154849    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154853    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154858    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154862    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.156522 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154866    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154872    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154877    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154881    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154886    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154890    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154894    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154899    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154903    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154907    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154912    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154916    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154921    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154925    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154929    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154933    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154938    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154942    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154946    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.157376 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154950    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154956    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154960    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154965    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154969    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154973    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154977    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154982    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154986    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154990    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154994    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.154999    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155003    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155007    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155014    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155019    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155023    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155027    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155031    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155036    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.158274 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155040    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155044    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155049    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155053    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155057    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.155061    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156309    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156320    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156325    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156330    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156336    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156341    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156346    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156350    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156356    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156361    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156366    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156370    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156374    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156379    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.159217 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156383    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156388    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156392    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156397    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156401    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156406    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156410    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156415    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156419    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156424    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156429    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156433    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156437    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156442    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156446    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156450    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156454    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156458    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156462    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156467    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.160193 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156471    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156476    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156480    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156484    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156489    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156493    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156497    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156508    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156512    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156524    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156528    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156532    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156536    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156541    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156545    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156549    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156554    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156558    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156562    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156567    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.161033 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156571    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156575    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156579    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156583    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156588    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156592    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156598    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156605    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156610    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156614    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156618    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156623    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156627    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156631    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156635    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156639    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156644    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156669    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156677    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.161540 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156683    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156689    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156696    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156700    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156704    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156709    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156713    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156717    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156721    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156726    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156730    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156734    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156738    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156742    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156747    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156751    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156755    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156759    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156763    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.162046 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156767    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156772    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156776    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156780    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156784    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156788    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156794    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156798    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156802    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156806    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156810    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156815    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156819    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.156823    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157637    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157648    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157684    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157688    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157693    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157698    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.162696 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157702    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157707    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157711    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157715    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157720    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157724    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157728    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157733    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157738    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157742    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157746    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157750    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157754    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157759    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157763    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157768    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157772    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157776    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157780    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.163181 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157785    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157789    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157793    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157797    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157801    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157806    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157810    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157814    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157822    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157826    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157831    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157836    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157840    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157844    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157848    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157852    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157857    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157861    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157865    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157869    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.163639 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157873    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157877    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157881    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157886    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157890    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157894    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157899    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157903    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157908    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157912    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157916    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157920    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157925    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157929    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157934    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157938    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157942    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157949    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157955    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.164153 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157959    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157965    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157969    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157974    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157978    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157982    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157986    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157993    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.157999    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158004    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158008    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158020    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158026    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158031    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158035    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158039    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158043    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158048    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158052    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158056    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.164753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158061    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158067    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158072    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158076    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158080    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158085    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158089    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158093    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158097    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158101    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158106    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158110    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158114    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158120    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158126    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158131    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158135    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158139    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158143    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.165229 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158148    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158151    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.158156    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158294    6064 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158307    6064 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158316    6064 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158323    6064 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158330    6064 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158335    6064 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158341    6064 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158348    6064 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158353    6064 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158358    6064 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158364    6064 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158371    6064 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158376    6064 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158381    6064 flags.go:64] FLAG: --cgroup-root=""
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158385    6064 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158390    6064 flags.go:64] FLAG: --client-ca-file=""
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158394    6064 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158399    6064 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158406    6064 flags.go:64] FLAG: --cluster-domain=""
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158411    6064 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158416    6064 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 18:37:41.165744 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158421    6064 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158426    6064 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158435    6064 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158439    6064 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158444    6064 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158450    6064 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158455    6064 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158460    6064 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158464    6064 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158469    6064 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158474    6064 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158480    6064 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158486    6064 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158490    6064 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158495    6064 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158500    6064 flags.go:64] FLAG: --enable-server="true"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158504    6064 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158510    6064 flags.go:64] FLAG: --event-burst="100"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158515    6064 flags.go:64] FLAG: --event-qps="50"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158520    6064 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158525    6064 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158529    6064 flags.go:64] FLAG: --eviction-hard=""
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158542    6064 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158547    6064 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158551    6064 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 18:37:41.166351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158556    6064 flags.go:64] FLAG: --eviction-soft=""
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158561    6064 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158566    6064 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158571    6064 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158575    6064 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158580    6064 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158584    6064 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158589    6064 flags.go:64] FLAG: --feature-gates=""
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158595    6064 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158602    6064 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158607    6064 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158612    6064 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158616    6064 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158622    6064 flags.go:64] FLAG: --help="false"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158627    6064 flags.go:64] FLAG: --hostname-override="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158633    6064 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158637    6064 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158642    6064 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158666    6064 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158673    6064 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158678    6064 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158682    6064 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158687    6064 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 18:37:41.166985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158691    6064 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158696    6064 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158701    6064 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158705    6064 flags.go:64] FLAG: --kube-reserved=""
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158710    6064 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158715    6064 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158722    6064 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158726    6064 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158731    6064 flags.go:64] FLAG: --lock-file=""
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158735    6064 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158740    6064 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158745    6064 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158754    6064 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158759    6064 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158763    6064 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158768    6064 flags.go:64] FLAG: --logging-format="text"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158772    6064 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158778    6064 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158785    6064 flags.go:64] FLAG: --manifest-url=""
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158790    6064 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158796    6064 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158801    6064 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158807    6064 flags.go:64] FLAG: --max-pods="110"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158813    6064 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158818    6064 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 18:37:41.167528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158823    6064 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158828    6064 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158833    6064 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158838    6064 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158842    6064 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158852    6064 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158856    6064 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158861    6064 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158866    6064 flags.go:64] FLAG: --pod-cidr=""
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158870    6064 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158875    6064 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158880    6064 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158884    6064 flags.go:64] FLAG: --port="10250"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158891    6064 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158895    6064 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0d3ca12c0c8ddea80"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158900    6064 flags.go:64] FLAG: --qos-reserved=""
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158905    6064 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158910    6064 flags.go:64] FLAG: --register-node="true"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158915    6064 flags.go:64] FLAG: --register-with-taints=""
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158921    6064 flags.go:64] FLAG: --registry-burst="10"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158926    6064 flags.go:64] FLAG: --registry-qps="5"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158930    6064 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158935    6064 flags.go:64] FLAG: --reserved-memory=""
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158941    6064 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158946    6064 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158952    6064 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 18:37:41.168152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158956    6064 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158961    6064 flags.go:64] FLAG: --runonce="false"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158966    6064 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158971    6064 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158976    6064 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158983    6064 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158987    6064 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158992    6064 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.158997    6064 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159001    6064 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159006    6064 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159010    6064 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159015    6064 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159020    6064 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159025    6064 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159029    6064 flags.go:64] FLAG: --system-cgroups=""
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159034    6064 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159042    6064 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159047    6064 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159053    6064 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159061    6064 flags.go:64] FLAG: --tls-min-version=""
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159065    6064 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159070    6064 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159075    6064 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159079    6064 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 18:37:41.168777 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159084    6064 flags.go:64] FLAG: --v="2"
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159090    6064 flags.go:64] FLAG: --version="false"
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159097    6064 flags.go:64] FLAG: --vmodule=""
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159103    6064 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159109    6064 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159330    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159341    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159347    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159352    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159357    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159361    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159365    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159370    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159375    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159379    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159383    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159387    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159392    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159396    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159401    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.169779 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159405    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159409    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159413    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159417    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159422    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159426    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159433    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159438    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159442    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159447    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159451    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159456    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159460    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159464    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159468    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159472    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159477    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159481    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159487    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159491    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.170482 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159495    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159500    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159504    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159508    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159512    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159516    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159521    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159527    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159532    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159537    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159541    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159545    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159552    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159558    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159563    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159567    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159572    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159576    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159582    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.171041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159587    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159591    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159595    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159599    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159604    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159608    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159613    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159617    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159621    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159626    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159630    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159635    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159640    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159644    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159667    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159672    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159676    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159680    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159684    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159689    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.171673 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159694    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159698    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159703    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159707    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159711    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159715    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159719    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159723    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159727    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159732    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159737    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159742    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159747    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159751    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159755    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159759    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159764    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159768    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159782    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.172218 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159786    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159790    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159795    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159799    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159805    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159810    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159814    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159819    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159823    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159827    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159831    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159836    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159840    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.159882    6064 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159946    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159953    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.172712 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159957    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159963    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159967    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159971    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159976    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159980    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159984    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159989    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159995    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.159999    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160003    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160008    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160012    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160016    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160020    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160025    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160029    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160033    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160038    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160042    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.173083 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160047    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160052    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160056    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160061    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160065    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160070    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160074    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160078    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160082    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160087    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160093    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160100    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160105    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160109    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160114    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160120    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160126    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160132    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.173568 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160137    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160141    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160147    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160152    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160156    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160161    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160165    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160169    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160174    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160178    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160182    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160186    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160190    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160195    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160198    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160203    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160207    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160211    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160216    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160220    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.174041 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160224    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160228    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160233    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160237    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160241    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160247    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160252    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160256    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160261    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160265    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160269    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160273    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160277    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160282    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160288    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160292    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160296    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160300    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160305    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.174537 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160309    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160313    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160317    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160321    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160326    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160330    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160334    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160339    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160343    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160347    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160351    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160355    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160360    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160364    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160368    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160372    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160377    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160381    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160385    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160391    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.175071 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160396    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160400    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160404    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160409    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160413    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160417    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.160422    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.164500    6064 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.164517    6064 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.164535    6064 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.164539    6064 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164600    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164604    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164607    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164610    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164613    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164616    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164618    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164621    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164623    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.175539 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164626    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164628    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164631    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164634    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164637    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164640    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164643    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164646    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164648    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164667    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164670    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164673    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164675    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164678    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164680    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164683    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164685    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164688    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164690    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164693    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.176031 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164701    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164704    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164706    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164709    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164711    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164714    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164716    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164719    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164721    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164724    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164726    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164729    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164731    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164734    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164737    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164739    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164742    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164745    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164748    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164751    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.176508 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164753    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164755    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164758    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164761    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164763    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164766    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164769    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164771    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164774    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164776    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164779    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164782    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164785    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164795    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164798    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164800    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164803    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164805    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164807    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164810    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.177042 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164813    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164815    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164818    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164820    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164822    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164825    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164828    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164830    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164833    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164835    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164840    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164844    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164847    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164850    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164853    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164855    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164858    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164860    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164863    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.177517 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164866    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164868    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164871    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164873    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164876    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164879    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164881    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164889    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164892    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164894    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164896    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164900    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164904    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164907    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164910    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164913    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164915    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.178045 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.164918    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.164945    6064 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165135    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165140    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165142    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165145    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165148    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165150    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165153    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165155    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165158    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165160    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165163    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165165    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165168    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165170    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.178477 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165173    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165175    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165178    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165180    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165182    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165186    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165190    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165198    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165201    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165203    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165206    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165209    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165211    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165214    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165216    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165219    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165221    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165224    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165227    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.178894 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165229    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165232    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165234    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165237    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165240    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165242    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165245    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165247    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165249    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165252    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165255    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165257    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165260    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165262    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165265    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165267    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165269    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165272    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165274    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.179356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165278    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165282    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165290    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165293    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165296    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165299    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165302    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165305    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165307    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165311    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165313    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165316    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165318    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165320    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165323    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165325    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165328    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165330    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165333    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.179904 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165335    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165337    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165340    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165342    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165345    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165353    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165355    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165358    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165360    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165363    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165365    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165367    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165370    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165372    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165374    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165377    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165384    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165387    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165390    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165392    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.180353 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165395    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165397    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165399    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165402    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165404    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165407    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165409    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165412    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165414    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165416    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165419    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165421    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165423    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165426    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165428    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.165455    6064 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165494    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 18:37:41.180897 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165499    6064 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165502    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165504    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165507    6064 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165509    6064 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165512    6064 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165514    6064 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165517    6064 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165519    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165522    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165524    6064 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165527    6064 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165535    6064 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165538    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165540    6064 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165543    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165545    6064 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165548    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165550    6064 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165552    6064 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 18:37:41.181311 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165555    6064 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165557    6064 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165559    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165562    6064 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165564    6064 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165566    6064 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165569    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165571    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165574    6064 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165576    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165579    6064 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165582    6064 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165585    6064 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165587    6064 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165590    6064 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165592    6064 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165595    6064 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165597    6064 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165600    6064 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165602    6064 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165605    6064 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 18:37:41.181820 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165607    6064 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165610    6064 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165612    6064 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165615    6064 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165622    6064 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165625    6064 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165628    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165631    6064 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165634    6064 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165636    6064 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165639    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165641    6064 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165643    6064 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165646    6064 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165648    6064 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165673    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165675    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165679    6064 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165683    6064 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 18:37:41.182368 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165686    6064 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165689    6064 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165691    6064 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165695    6064 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165697    6064 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165700    6064 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165705    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165707    6064 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165710    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165712    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165715    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165717    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165720    6064 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165722    6064 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165725    6064 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165727    6064 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165730    6064 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165732    6064 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165740    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 18:37:41.182859 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165743    6064 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165745    6064 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165748    6064 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165750    6064 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165753    6064 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165755    6064 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165758    6064 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165761    6064 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165763    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165766    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165768    6064 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165771    6064 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165774    6064 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165778    6064 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165782    6064 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165785    6064 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165789    6064 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165791    6064 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 18:37:41.183356 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165794    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165798    6064 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165800    6064 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165804    6064 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165806    6064 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165809    6064 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165811    6064 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:37:41.165813    6064 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.165871    6064 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.166910    6064 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.166958    6064 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.167161    6064 server.go:1014] "Starting client certificate rotation"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.167301    6064 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.167358    6064 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:31:29 +0000 UTC" deadline="2028-05-19 23:41:40.511188929 +0000 UTC"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.167396    6064 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13613h3m59.34379691s"
Oct 30 18:37:41.183903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.167677    6064 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:37:41.184271 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.168858    6064 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 18:37:41.184271 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.171623    6064 log.go:25] "Validated CRI v1 runtime API"
Oct 30 18:37:41.184271 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.173464    6064 log.go:25] "Validated CRI v1 image API"
Oct 30 18:37:41.184271 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.174170    6064 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 18:37:41.184271 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.176473    6064 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ad21b33a-55c8-4bdd-9d13-584043c4ddec:/dev/nvme0n1p4 e3e4f1d5-f3d5-4fa0-9216-11f6f06639af:/dev/nvme0n1p3]
Oct 30 18:37:41.184433 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.176497    6064 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843/userdata/shm major:0 minor:288 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767/userdata/shm major:0 minor:398 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e/userdata/shm major:0 minor:524 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235/userdata/shm major:0 minor:286 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303/userdata/shm major:0 minor:365 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628/userdata/shm major:0 minor:372 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6/userdata/shm major:0 minor:284 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308/userdata/shm major:0 minor:523 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858/userdata/shm major:0 minor:521 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5/userdata/shm major:0 minor:470 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4/userdata/shm major:0 minor:507 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~projected/kube-api-access-29nn2:{mountpoint:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~projected/kube-api-access-29nn2 major:0 minor:387 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:384 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:383 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:378 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/134db473-2a39-4577-861a-09778c502691/volumes/kubernetes.io~projected/kube-api-access-b62lf:{mountpoint:/var/lib/kubelet/pods/134db473-2a39-4577-861a-09778c502691/volumes/kubernetes.io~projected/kube-api-access-b62lf major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/134db473-2a39-4577-861a-09778c502691/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/134db473-2a39-4577-861a-09778c502691/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/alertmanager/9 major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/config-reloader/6 major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~empty-dir/config-out major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~projected/kube-api-access-l8wd4:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~projected/kube-api-access-l8wd4 major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~projected/tls-assets major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/config-volume major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/web-config major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~projected/kube-api-access-9g77m:{mountpoint:/var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~projected/kube-api-access-9g77m major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cad6579-f0f3-43f5-b522-af8da26ad7b5/volumes/kubernetes.io~projected/kube-api-access-jbfzz:{mountpoint:/var/lib/kubelet/pods/2cad6579-f0f3-43f5-b522-af8da26ad7b5/volumes/kubernetes.io~projected/kube-api-access-jbfzz major:0 minor:520 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~projected/kube-api-access-r9j4b:{mountpoint:/var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~projected/kube-api-access-r9j4b major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~projected/kube-api-access-rz6bn:{mountpoint:/var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~projected/kube-api-access-rz6bn major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33d580e1-86c1-41a5-b0ed-3c846111d6b4/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/33d580e1-86c1-41a5-b0ed-3c846111d6b4/volumes/kubernetes.io~secret/agent-certs major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e958fd3-b9bf-455f-a339-39de790991ee/volumes/kubernetes.io~projected/kube-api-access-4qxzj:{mountpoint:/var/lib/kubelet/pods/3e958fd3-b9bf-455f-a339-39de790991ee/volumes/kubernetes.io~projected/kube-api-access-4qxzj major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e958fd3-b9bf-455f-a339-39de790991ee/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/3e958fd3-b9bf-455f-a339-39de790991ee/volumes/kubernetes.io~secret/metrics-certs major:0 minor:514 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e6fda66-4524-4933-b497-2056bb7ed874/volumes/kubernetes.io~projected/kube-api-access-jsv66:{mountpoint:/var/lib/kubelet/pods/4e6fda66-4524-4933-b497-2056bb7ed874/volumes/kubernetes.io~projected/kube-api-access-jsv66 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~projected/kube-api-access-j5vnv:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~projected/kube-api-access-j5vnv major:0 minor:364 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/72812209-4f7e-4e07-8b12-e2271ad4470f/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/72812209-4f7e-4e07-8b12-e2271ad4470f/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:519 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volumes/kubernetes.io~projected/kube-api-access-sbcq8:{mountpoint:/var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volumes/kubernetes.io~projected/kube-api-access-sbcq8 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/94271eb5-adea-4fe1-a166-baae2421784f/volumes/kubernetes.io~projected/kube-api-access-cftgr:{mountpoint:/var/lib/kubelet/pods/94271eb5-adea-4fe1-a166-baae2421784f/volumes/kubernetes.io~projected/kube-api-access-cftgr major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~projected/kube-api-access-gk56v:{mountpoint:/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~projected/kube-api-access-gk56v major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~projected/kube-api-access-fmljb:{mountpoint:/var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~projected/kube-api-access-fmljb major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~projected/kube-api-access-6wfg7:{mountpoint:/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~projected/kube-api-access-6wfg7 major:0 minor:371 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:370 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~projected/kube-api-access-j29wt:{mountpoint:/var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~projected/kube-api-access-j29wt major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:279 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:278 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab645310-3a44-4917-ab17-6f4a9e26763b/volumes/kubernetes.io~projected/kube-api-access-d4xzz:{mountpoint:/var/lib/kubelet/pods/ab645310-3a44-4917-ab17-6f4a9e26763b/volumes/kubernetes.io~projected/kube-api-access-d4xzz major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2/volumes/kubernetes.io~projected/kube-api-access-zrmsx:{mountpoint:/var/lib/kubelet/pods/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2/volumes/kubernetes.io~projected/kube-api-access-zrmsx major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~projected/kube-api-access-fztlg:{mountpoint:/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~projected/kube-api-access-fztlg major:0 minor:509 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:506 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:502 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b74b9bd1-8acf-4839-9c82-84baf2e3b636/volumes/kubernetes.io~projected/kube-api-access-2q67r:{mountpoint:/var/lib/kubelet/pods/b74b9bd1-8acf-4839-9c82-84baf2e3b636/volumes/kubernetes.io~projected/kube-api-access-2q67r major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b74b9bd1-8acf-4839-9c82-84baf2e3b636/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b74b9bd1-8acf-4839-9c82-84baf2e3b636/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4/volumes/kubernetes.io~projected/kube-api-access-9d6qg:{mountpoint:/var/lib/kubelet/pods/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4/volumes/kubernetes.io~projected/kube-api-access-9d6qg major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/config-reloader/2 major:0 minor:466 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:466 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/prometheus/15 major:0 minor:466 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~empty-dir/config-out major:0 minor:462 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~projected/kube-api-access-w6jl5:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~projected/kube-api-access-w6jl5 major:0 minor:469 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~projected/tls-assets major:0 minor:460 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/config major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:465 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:464 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:463 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:459 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:468 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:467 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/web-config major:0 minor:466 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f27d0d9e-e2a4-44b2-a181-caefff4bc502/volumes/kubernetes.io~projected/kube-api-access-vtgzc:{mountpoint:/var/lib/kubelet/pods/f27d0d9e-e2a4-44b2-a181-caefff4bc502/volumes/kubernetes.io~projected/kube-api-access-vtgzc major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f29e62d4-6063-432c-a721-e817f002b5a2/volumes/kubernetes.io~projected/kube-api-access-rg4ws:{mountpoint:/var/lib/kubelet/pods/f29e62d4-6063-432c-a721-e817f002b5a2/volumes/kubernetes.io~projected/kube-api-access-rg4ws major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f29e62d4-6063-432c-a721-e817f002b5a2/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/f29e62d4-6063-432c-a721-e817f002b5a2/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:207 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/de658cd3b050effc3c48e4241bed798ea453a980751abd05c2280351c5de271f/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/24e1ef8f0a25e6d37efdb68b57dfd8a387365753a18ea7b81f6c5952884c6b17/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/2f5aa30ba55e455136087f7aec5ab0dbfb18ab689587eb927e3232400367343e/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/f92d5fbdcc25a6855aef7bb3cdb6acf159e32a14b6bd6622f4ee6c7b2769813b/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/c5f90a767704dd302c0d65c5749bcefa6bffd6b159a3c80284ffeeccd7bf4cce/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/8619077cedf7f9420ddf7f5731f352730c80b3621de3194171d097c96839c7dd/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/be1aac3102bc0abd92636b4431a9f106a773d0f89509b44f9ee150bc313f5feb/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/e760b6edb212bb38322029e0a7fef7348fbee26954b3ff1d98eeb91be63939c1/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/fd7b85a6d003dd730bf0943481d3f9c3954e5a167836649cbc96d1a20b552db3/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/02c88625e735c0671f4fa1e9ab718b045ccf62218e86ac80c21581e5129a5254/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/b14bd71fe795702477324aa86c3e3f3a89b3a700755922bda3b2197105100eb8/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/0c17c1748a102ce6846a636b9183f63a9c312645a2ff6967b4c64d5796be7b5e/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/3c2e479fd30d60428fdc7e5038b09621d58b1286cb7ff8cd69771ccf36b8be97/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/1e9bba615bd022424bf00215ed41eef3100930afd8bfd03041021243c60b0389/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/926ab68385c6504274d77547bbce0ecd2cefefbc3116bfe4e3c07525c389f0d2/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/9b03eb293ce41bce96dee92615268ea6c5e0e4eeee496fb5ad5ee20f27bf9b58/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/419b9219ad505b241e080ab77592bad9217570e9a747e0d53c8836a157c3ca78/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/77d9fb8d82c5951a808c8b86ce4316101ce4a1d103ee4bdddd7f8495d7b2434a/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/d8a2f788a451ae2e7d7b789af8eb6af8c85e2f2606f7dd1c762a95b5876aed8f/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/92de0dba7de7bb2ef4508873cb43e0f4ffd97a62b3b6b1bcd3fc09372575b14c/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/4ec017d5ed33bf7fa314e5c26b7042aecab4473fc9cdc08828fe811bdf6a7128/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/a28fd6a291562662a0065dfeaa3aec9c349fc6aecd13c8d77ee7212f0feaa84e/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/eb3db3d8bfe1b037add291d7b7facbce81bec49f2736d04d2cd1079008d68f58/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/486dc403967aed507a202da9e5b87a2f0b930baf4206d060b57bb875ec2a2498/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/a61a79e89e75e5f08a41a809d44e94022253e25f7a13a253a3302a6083dd77e4/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/a1513d7e39656a38fb708abeef50cb1aa479d3fbea702e71205985921f4e0fef/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/5f9ca377fc6b8af3c93be4def66f8237b25a506fa8e6eb9112ffc89a7471c650/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/33f17178aa5714fff6cd3621f37ebf23d0600fccec3156c91dbc5c1dace4e71a/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/f04e428a78db1461320b0e2310026e487ea13d0bb738e43fe7537c5340c7980a/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/1769e472f90568e9d9718b174673084136668ad4bd21278401048bbc68a789df/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/0b27763926ce0c433bf137f552e8aa3b4296d59213be627f25164d96f3a827c4/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/8ad2f838609ad2d34a1fae2a009cbd953a1b25ca8b49001bf0bededec3b5356c/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/95799f8acaeff1a352c31ebb7c5469a88bb7aa9f62a41d9838a8b04b0b483ff7/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/c47022ff21a72e9e9bbcf02d90d238b7501709098bca6e0907ea3b0d44240a14/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-290:{mountpoint:/var/lib/containers/storage/overlay/150b7e59ba165d631a4ef4f67b58caccf1d8b3d0ebe57c01a5026704cdd9ee2b/merged major:0 minor:290 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/0ce205c7152fd90b712b24053eece8b1345b315c1a6a440661cf2ff0a99e9df7/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/5d1896a8733d25e864ebc536445482e6aefcb748ca0fbf00dd3d2892ab8cffb8/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/713dc452689cbe2e633a11f1d912c19f774fad784b4aae0bf73e26f4f516bc5d/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/403eaa044d153477bb91793dbd621491d13411b23b658fb56505dfb2ec49f923/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/049cef3b718cb2ee42795f7683c5b48bb22ca77b3ae09e09b1a443b27051e79b/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/c4b9323f690a3cbdbcadd85511669fbcab13214b93ac77aec52e7c78231c4fdc/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/5909565f15f8c4b365a3c0b56b247ac6640ede3ed1f0f10dc87ad95c175fa80f/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/1a083e3f2234fa939a2b41c1ec43ce48fa40af13214a7adb677e492507d7081a/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/85ca92ae58cde47f51532cc45e157e742d6efe519fca2100a1170c03fa8d1d39/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/136702ef4e348ba5b86d0251f27cd17b5bb329c7945679781da20d7cf456a016/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/3f9cc8e4eb81e165553d60e909c4019b6dda33bb96e9d3d37d72b3983659eb77/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/8ffb22a62cd3168ac40063e14d019d15795e395c35b19ea87c60cbd0dc299b98/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/efd54986c16bd562b4df8a88ecf00c0b59dc605f3090900364c0bf63a54ce6dd/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/90943d2c435b98d3c7e730c4304395ee29466194b602a161d34de9ae89ac7be5/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/88c8fb24ee50a6b88dea5ab6680adee7816aca84061c965388085d6d0d6b6fe2/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/5fab464c11b71991ed1a533bf92fb070ab7094bb23de855e1fbb770c4e1bf9b0/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/54f774bfe4d24d7cf698231faee48973be7cf9129f3258009856e961d10fc74b/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-394:{mountpoint:/var/lib/containers/storage/overlay/f73834396e958d48f9f9eba48e16ac165f10d30e41f553529580b5aed652b64a/merged major:0 minor:394 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/ac2ae8d53ff172d7d338a6e586607a20b3ff7d420c2b8a73276f45fc371abaa3/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-406:{mountpoint:/var/lib/containers/storage/overlay/dd8e78c620b6498aa95d99265d1d5acc5b79c7a99be957c538fc93c0172fc115/merged major:0 minor:406 fsType:overlay blockSize:0} overlay_0-411:{mountpoint:/var/lib/containers/storage/overlay/282da426570524aa5e6e31f5617887b4746efde4161566a40a57af4473f8d4db/merged major:0 minor:411 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/96a915140f8146173950002ad5a879d08aa9d1742b653d344f6e477726d30854/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/d9d77e177720969d83548a97d614d2e2b62733d9fa48cc735115109e859a658c/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/fc547b3cdd9415ca2e7646bb1e9ce0a59d144a4639f321ef6990a403a42a885a/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/01737d71d25321585c37bd54d2bee0e68cb36681d24dd6978cc5d12263d38856/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/e2e0529d7a32597b32c50ddd42edc629de9373bafd1372b791704c1190d256c2/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-436:{mountpoint:/var/lib/containers/storage/overlay/9c936f0a5c700a69f3aa9c21e900bb65fc3dc5d8df3941dfde5528163d27f913/merged major:0 minor:436 fsType:overlay blockSize:0} overlay_0-444:{mountpoint:/var/lib/containers/storage/overlay/aa1d871a73c046efbd8692572ccf2c8a670b6c2017b09df7d842a91b32dcac44/merged major:0 minor:444 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/b25a8330b8bd405b6d9147bd191458fd8f6ed684280411dfc5e2518cfb860211/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-472:{mountpoint:/var/lib/containers/storage/overlay/df6c43d2adc5bc523fc8335d27a35c94372c14deafdfac442db3f7a3eabfb4c3/merged major:0 minor:472 fsType:overlay blockSize:0} overlay_0-474:{mountpoint:/var/lib/containers/storage/overlay/0d94429581cf6e649cf4e36db20348473c3029ac17409d60f85f8f2b644e1a70/merged major:0 minor:474 fsType:overlay blockSize:0} overlay_0-476:{mountpoint:/var/lib/containers/storage/overlay/cc35b5492603a494464c314b10e2b3a46e628734eefa4c434bf650438c372c48/merged major:0 minor:476 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/a6404cb4e51656332230577483b5f5a40a587128460a4303b82289c6b4bb4db6/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-487:{mountpoint:/var/lib/containers/storage/overlay/3d8245d626ecf2aeafa3fc1b805fed391b2e4fa42613f9d1436fdd72fe6038db/merged major:0 minor:487 fsType:overlay blockSize:0} overlay_0-492:{mountpoint:/var/lib/containers/storage/overlay/cea3ddee3eab310c93b4fa1ef8d716a9610d2f43c0e475f75938fb8739b55793/merged major:0 minor:492 fsType:overlay blockSize:0} overlay_0-497:{mountpoint:/var/lib/containers/storage/overlay/7b9191eee39ccf9ddb2dac67a9b3acbe10305a4c8d48eb223af9e33429e2ff07/merged major:0 minor:497 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/a7d4fb0bed9f49b08bff20ca7b247fe30f38b5f722f17a8fe5e707643245842f/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-510:{mountpoint:/var/lib/containers/storage/overlay/b235ccb650c374df44cf9c8a41dcf2ac006912d0324b877e5671c9e694632957/merged major:0 minor:510 fsType:overlay blockSize:0} overlay_0-512:{mountpoint:/var/lib/containers/storage/overlay/1c26d05305ee904fc0058e28fa3decd164644609a30d97ed50ed34621b5a42e1/merged major:0 minor:512 fsType:overlay blockSize:0} overlay_0-527:{mountpoint:/var/lib/containers/storage/overlay/0590b74de009c03070ab95a4c9fa7a97baae47f8e2a58eb4c56af7e3d68dfe36/merged major:0 minor:527 fsType:overlay blockSize:0} overlay_0-529:{mountpoint:/var/lib/containers/storage/overlay/880547ca388ec2d7efae0b8fe5ab1713a395965f0940730a7d78adf7a2f1c08f/merged major:0 minor:529 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/a4cabfc8471d1f90b98e821f6953890ed5913d31bf2bbfb4f2ae9b2b53b5ed77/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-531:{mountpoint:/var/lib/containers/storage/overlay/fb3ec937abbb1db7dabfb5a55adee67d84729c946c0e4cefae509fba5bfc7960/merged major:0 minor:531 fsType:overlay blockSize:0} overlay_0-533:{mountpoint:/var/lib/containers/storage/overlay/2d9eab73ae7f20bb5020d32cb92e2108a57fa74411aedeaf6d3ba6d289536b75/merged major:0 minor:533 fsType:overlay blockSize:0} overlay_0-535:{mountpoint:/var/lib/containers/storage/overlay/5b14b35a60759a53bd366cd5ab0eafdff889c5c1977304af774bb50d807dd0ea/merged major:0 minor:535 fsType:overlay blockSize:0} overlay_0-541:{mountpoint:/var/lib/containers/storage/overlay/614a7de1fc630881d1e1ba6b213955bc7cef518557c0e3225c34a2b3d168916d/merged major:0 minor:541 fsType:overlay blockSize:0} overlay_0-546:{mountpoint:/var/lib/containers/storage/overlay/2ca70f9cfad5560f4cdba8cd6051667753874689e26fbe062c0bd1878c030df9/merged major:0 minor:546 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/ab386fc37283c66639e46672382efecea4a20bc3e988808c787a0a20cc5ecdbe/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/548415dbdf50ecc3ba64b522b7c6af6801047a794c401d281f0ad51034664fe6/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/e2694475accabe91a4ec68c061c8284406892d66ff28204199194f950eaadf6e/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/c375af6a5d9b923a50d467b87f7a8721f14059e7c8a7e8d84d9e88e142b54a9f/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/9aeebb92c3b0882c47c339680138555cc68e42dd8766ab4935a61a3e4fae51b2/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/cb364e22d60243755a1733a69280bbbd9b4a59702c6092a64a9f20f855366f9a/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-93:{mountpoint:/var/lib/containers/storage/overlay/e624c3c1eb297bb22ccc43d491979d7d3ea1b6a51a1fc2518f8617e8aedb28d4/merged major:0 minor:93 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/19e7eca3aa662ffdd3e377069674c355e44038fa44bd36537a735aedbf416239/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 18:37:41.185413 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.184941    6064 manager.go:217] Machine: {Timestamp:2026-10-30 18:37:41.184461073 +0000 UTC m=+0.062733885 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098124 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec222c053e64b844eec0bf6e4efb0286 SystemUUID:ec222c05-3e64-b844-eec0-bf6e4efb0286 BootID:41968581-61ea-42e6-bbb3-217dc75d1db7 Filesystems:[{Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1e78265281cbfbf872e8ed20dd38d5216e701af9a0ccdc6f6211c4a7b3861843/userdata/shm DeviceMajor:0 DeviceMinor:288 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/134db473-2a39-4577-861a-09778c502691/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~projected/kube-api-access-rz6bn DeviceMajor:0 DeviceMinor:230 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8db0cc353ad268f4c35e6b750d41405504c1be78cd75f99eb96d26ecfabda303/userdata/shm DeviceMajor:0 DeviceMinor:365 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:466 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~projected/kube-api-access-j5vnv DeviceMajor:0 DeviceMinor:364 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~projected/kube-api-access-w6jl5 DeviceMajor:0 DeviceMinor:469 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:466 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-492 DeviceMajor:0 DeviceMinor:492 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-510 DeviceMajor:0 DeviceMinor:510 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bef30af71023d04a79a4c04d4801046d9fc26baf3109697fa43169a4d118b308/userdata/shm DeviceMajor:0 DeviceMinor:523 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-529 DeviceMajor:0 DeviceMinor:529 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-541 DeviceMajor:0 DeviceMinor:541 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ab645310-3a44-4917-ab17-6f4a9e26763b/volumes/kubernetes.io~projected/kube-api-access-d4xzz DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7fb6bbd08c28c5c5158019bcb2a2eef6fe7adf95ecc808f8f0cdc50008e99da4/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~projected/kube-api-access-fmljb DeviceMajor:0 DeviceMinor:281 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~projected/kube-api-access-6wfg7 DeviceMajor:0 DeviceMinor:371 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-436 DeviceMajor:0 DeviceMinor:436 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-472 DeviceMajor:0 DeviceMinor:472 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4/volumes/kubernetes.io~projected/kube-api-access-9d6qg DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~projected/kube-api-access-r9j4b DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b59797825c83787f0d855a465860fca90c9faa91f87770bc6be3613f38d2144/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:370 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/57804cccdc37681e7c177d5c6ccbcccd6fb1719be1e3a85560063575b2cac632/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~projected/kube-api-access-29nn2 DeviceMajor:0 DeviceMinor:387 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-406 DeviceMajor:0 DeviceMinor:406 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:467 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4e6fda66-4524-4933-b497-2056bb7ed874/volumes/kubernetes.io~projected/kube-api-access-jsv66 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:318 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:362 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:466 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/63561b3a290358f6966f61a6a72cfdb4eaa0137c56a6671a98eccab4302f06cc/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/55dd14e624d35ee1a05703ebf7d45fc592b2f6f410fdba5099e6e8059f5ddeb8/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:278 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-527 DeviceMajor:0 DeviceMinor:527 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:276 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/40e5f938c46d08fef8a07d4704229dbdce0121eb21e4675f895a2eb5725a1235/userdata/shm DeviceMajor:0 DeviceMinor:286 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3e958fd3-b9bf-455f-a339-39de790991ee/volumes/kubernetes.io~projected/kube-api-access-4qxzj DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:269 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:460 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8c613b38c644b6169cb5d5f3c56f347933bf28840a906844039e005fe5a646ef/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:315 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-394 DeviceMajor:0 DeviceMinor:394 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:459 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:277 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-474 DeviceMajor:0 DeviceMinor:474 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:502 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-411 DeviceMajor:0 DeviceMinor:411 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d64a29c16eaa5131bdbd6d274a85f49d92bfa6cc76c45abab46fe3be3de2c3e/userdata/shm DeviceMajor:0 DeviceMinor:524 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bac3f00ae53825abca6ee2010592272a6d65624bdc8c2656ead4dfb4b4baa6d3/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3201fe70-508e-4bba-8ad4-79a9f33a7df2/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:229 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:280 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bbae51b67d9d640b73386e9cf0d53338cb08d7fbf9929d1e37c531fb995e9ae6/userdata/shm DeviceMajor:0 DeviceMinor:284 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5/userdata/shm DeviceMajor:0 DeviceMinor:470 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b74b9bd1-8acf-4839-9c82-84baf2e3b636/volumes/kubernetes.io~projected/kube-api-access-2q67r DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f29e62d4-6063-432c-a721-e817f002b5a2/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:363 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-512 DeviceMajor:0 DeviceMinor:512 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2/volumes/kubernetes.io~projected/kube-api-access-zrmsx DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e88f2f52862b78230bd1c6afa7b088e4d2cb0c6c36e9c544af8a8d5b28896690/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-444 DeviceMajor:0 DeviceMinor:444 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:465 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:468 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:309 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:466 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a96c523-b3c5-49e5-b785-d6bb59ac17ef/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:275 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:316 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:461 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2cad6579-f0f3-43f5-b522-af8da26ad7b5/volumes/kubernetes.io~projected/kube-api-access-jbfzz DeviceMajor:0 DeviceMinor:520 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/50de14fd07e291fa309f624b383b68c47c37111d7d6bc8287d4830f41751a23e/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:313 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3e958fd3-b9bf-455f-a339-39de790991ee/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:514 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/33d580e1-86c1-41a5-b0ed-3c846111d6b4/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f27d0d9e-e2a4-44b2-a181-caefff4bc502/volumes/kubernetes.io~projected/kube-api-access-vtgzc DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:354 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:360 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:369 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:462 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-476 DeviceMajor:0 DeviceMinor:476 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-533 DeviceMajor:0 DeviceMinor:533 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/94271eb5-adea-4fe1-a166-baae2421784f/volumes/kubernetes.io~projected/kube-api-access-cftgr DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:320 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628/userdata/shm DeviceMajor:0 DeviceMinor:372 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:454 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:463 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-93 DeviceMajor:0 DeviceMinor:93 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:265 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:361 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/299e53dbcf218f96a91bc3fa2972536746ea5e3fce48ec5f1cf38683577b2767/userdata/shm DeviceMajor:0 DeviceMinor:398 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/72812209-4f7e-4e07-8b12-e2271ad4470f/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:519 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2bb1395d-e068-4d07-a218-971ffb972271/volumes/kubernetes.io~projected/kube-api-access-9g77m DeviceMajor:0 DeviceMinor:282 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:319 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:384 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4/userdata/shm DeviceMajor:0 DeviceMinor:507 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-535 DeviceMajor:0 DeviceMinor:535 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-546 DeviceMajor:0 DeviceMinor:546 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~projected/kube-api-access-j29wt DeviceMajor:0 DeviceMinor:283 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c16daf5bca221e2977a95307bafd1b933faa319a780e6975743c05a8e9dca858/userdata/shm DeviceMajor:0 DeviceMinor:521 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:317 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:378 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/07aedb61-c8c3-48b2-9a23-98fbc418c394/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:383 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cbd8f6a3fd23e3a8000ee9bc8aea4e9f701252529e5c3bd4c03cda199cb635c1/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7150c1a0-ddc4-458e-939b-25e28b3a0496/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:359 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-487 DeviceMajor:0 DeviceMinor:487 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-497 DeviceMajor:0 DeviceMinor:497 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~projected/kube-api-access-fztlg DeviceMajor:0 DeviceMinor:509 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-290 DeviceMajor:0 DeviceMinor:290 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-531 DeviceMajor:0 DeviceMinor:531 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f29e62d4-6063-432c-a721-e817f002b5a2/volumes/kubernetes.io~projected/kube-api-access-rg4ws DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:279 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:464 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/09ce698cc8ffc743159dbbba803f42b827deda27953e7306365e5f87cf22f996/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/df44fc9e42db22f9249c001fb6af08533ca3ac7c26027fc07766c25a3a3c15f4/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes/kubernetes.io~projected/kube-api-access-gk56v DeviceMajor:0 DeviceMinor:270 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:506 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b74b9bd1-8acf-4839-9c82-84baf2e3b636/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/134db473-2a39-4577-861a-09778c502691/volumes/kubernetes.io~projected/kube-api-access-b62lf DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:316 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes/kubernetes.io~projected/kube-api-access-l8wd4 DeviceMajor:0 DeviceMinor:321 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/volumes/kubernetes.io~projected/kube-api-access-sbcq8 DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:09ce698cc8ffc74 MacAddress:72:d7:f3:89:47:65 Speed:10000 Mtu:8901} {Name:299e53dbcf218f9 MacAddress:1e:fe:1e:46:b8:87 Speed:10000 Mtu:8901} {Name:3d64a29c16eaa51 MacAddress:06:48:fa:e9:35:88 Speed:10000 Mtu:8901} {Name:40e5f938c46d08f MacAddress:82:a0:be:1e:f9:86 Speed:10000 Mtu:8901} {Name:55dd14e624d35ee MacAddress:ae:ac:46:57:9f:70 Speed:10000 Mtu:8901} {Name:8db0cc353ad268f MacAddress:36:2a:a7:6d:44:56 Speed:10000 Mtu:8901} {Name:9b59797825c8378 MacAddress:9e:20:1e:7a:97:15 Speed:10000 Mtu:8901} {Name:9c79a8c32cb70f5 MacAddress:66:60:e4:17:01:cd Speed:10000 Mtu:8901} {Name:a844fa37bdd1373 MacAddress:9e:9b:61:12:5f:cf Speed:10000 Mtu:8901} {Name:bbae51b67d9d640 MacAddress:4e:8f:61:9c:52:1f Speed:10000 Mtu:8901} {Name:bef30af71023d04 MacAddress:a2:c6:30:2f:23:1f Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d6:82:1d:a9 Speed:0 Mtu:9001} {Name:br-int MacAddress:16:bf:99:f6:ea:ca Speed:0 Mtu:8901} {Name:c16daf5bca221e2 MacAddress:5e:75:0e:25:53:4c Speed:10000 Mtu:8901} {Name:d4cde33887bbaa6 MacAddress:52:37:88:b4:f2:2d Speed:10000 Mtu:8901} {Name:df44fc9e42db22f MacAddress:42:d8:52:23:02:98 Speed:10000 Mtu:8901} {Name:e3a218b4546a996 MacAddress:52:77:39:63:4b:88 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d6:82:1d:a9 Speed:0 Mtu:9001} {Name:f12d3d21b117e33 MacAddress:9e:07:26:0c:21:8d Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:22:fc:06:81:13:84 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:46:82:18:96:39:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 18:37:41.185677 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185418    6064 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 18:37:41.185677 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185457    6064 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 18:37:41.185820 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185799    6064 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 18:37:41.185947 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185820    6064 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-34.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 18:37:41.185988 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185950    6064 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 18:37:41.185988 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185957    6064 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 18:37:41.185988 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185970    6064 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:37:41.185988 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.185982    6064 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 18:37:41.186101 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186048    6064 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 18:37:41.186232 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186222    6064 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 18:37:41.186355 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186346    6064 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 18:37:41.186393 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186385    6064 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 18:37:41.186424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186403    6064 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 18:37:41.186424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186419    6064 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 18:37:41.186475 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186427    6064 kubelet.go:405] "Adding apiserver pod source"
Oct 30 18:37:41.186475 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.186436    6064 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 18:37:41.189511 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.189271    6064 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 18:37:41.189511 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.189362    6064 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:37:41.190165 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.190143    6064 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 18:37:41.193023 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193008    6064 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 18:37:41.193023 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193022    6064 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 18:37:41.193124 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193109    6064 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 18:37:41.193300 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193289    6064 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 18:37:41.193336 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193319    6064 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 18:37:41.193413 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193404    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193418    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193424    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193430    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193436    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193441    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193447    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193452    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 18:37:41.193457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193459    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 18:37:41.193805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193465    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 18:37:41.193805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193473    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 18:37:41.193805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193482    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 18:37:41.193805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193503    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 18:37:41.193805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.193509    6064 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 18:37:41.196813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.196799    6064 server.go:1263] "Started kubelet"
Oct 30 18:37:41.196914 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.196871    6064 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 18:37:41.197239 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.197168    6064 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 18:37:41.197341 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.197260    6064 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 18:37:41.197305 ip-10-0-135-34 systemd[1]: Started Kubernetes Kubelet.
Oct 30 18:37:41.197573 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.197521    6064 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 18:37:41.198063 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.198024    6064 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 18:37:41.200926 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.200909    6064 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 18:37:41.201047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.200930    6064 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 18:37:41.201047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.201060    6064 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:31:31 +0000 UTC" deadline="2028-05-15 17:27:11.96172556 +0000 UTC"
Oct 30 18:37:41.201047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.201090    6064 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 18:37:41.201047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.201095    6064 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13510h49m30.760633809s"
Oct 30 18:37:41.201047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.201100    6064 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 18:37:41.201639 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.201285    6064 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-34.us-east-2.compute.internal\" not found"
Oct 30 18:37:41.201639 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.201106    6064 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 18:37:41.204407 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.204383    6064 factory.go:55] Registering systemd factory
Oct 30 18:37:41.204407 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.204408    6064 factory.go:223] Registration of the systemd container factory successfully
Oct 30 18:37:41.205999 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.205977    6064 factory.go:153] Registering CRI-O factory
Oct 30 18:37:41.205999 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.206001    6064 factory.go:223] Registration of the crio container factory successfully
Oct 30 18:37:41.206150 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.206106    6064 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 18:37:41.206150 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.206122    6064 factory.go:103] Registering Raw factory
Oct 30 18:37:41.206150 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.206134    6064 manager.go:1199] Started watching for new ooms in manager
Oct 30 18:37:41.206836 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.206817    6064 manager.go:319] Starting recovery of all containers
Oct 30 18:37:41.211320 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211247    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 18:37:41.211460 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211424    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f29e62d4-6063-432c-a721-e817f002b5a2" volumeName="kubernetes.io/secret/f29e62d4-6063-432c-a721-e817f002b5a2-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 18:37:41.211580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211469    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca" seLinuxMountContext=""
Oct 30 18:37:41.211580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211483    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume" seLinuxMountContext=""
Oct 30 18:37:41.211580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211496    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3201fe70-508e-4bba-8ad4-79a9f33a7df2" volumeName="kubernetes.io/projected/3201fe70-508e-4bba-8ad4-79a9f33a7df2-kube-api-access-rz6bn" seLinuxMountContext=""
Oct 30 18:37:41.211580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211510    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 18:37:41.211580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211549    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.211580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211564    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211579    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="134db473-2a39-4577-861a-09778c502691" volumeName="kubernetes.io/empty-dir/134db473-2a39-4577-861a-09778c502691-tmp-dir" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211606    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211619    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb" volumeName="kubernetes.io/projected/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-kube-api-access-r9j4b" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211631    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e958fd3-b9bf-455f-a339-39de790991ee" volumeName="kubernetes.io/projected/3e958fd3-b9bf-455f-a339-39de790991ee-kube-api-access-4qxzj" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211644    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211681    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3201fe70-508e-4bba-8ad4-79a9f33a7df2" volumeName="kubernetes.io/configmap/3201fe70-508e-4bba-8ad4-79a9f33a7df2-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211696    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab645310-3a44-4917-ab17-6f4a9e26763b" volumeName="kubernetes.io/projected/ab645310-3a44-4917-ab17-6f4a9e26763b-kube-api-access-d4xzz" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211708    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211721    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211733    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211746    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="134db473-2a39-4577-861a-09778c502691" volumeName="kubernetes.io/configmap/134db473-2a39-4577-861a-09778c502691-config-volume" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211757    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-grpc-tls" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211770    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab645310-3a44-4917-ab17-6f4a9e26763b" volumeName="kubernetes.io/configmap/ab645310-3a44-4917-ab17-6f4a9e26763b-iptables-alerter-script" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211784    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211816    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/projected/07aedb61-c8c3-48b2-9a23-98fbc418c394-kube-api-access-29nn2" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211830    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211842    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211853    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211866    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 18:37:41.211896 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211879    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f29e62d4-6063-432c-a721-e817f002b5a2" volumeName="kubernetes.io/empty-dir/f29e62d4-6063-432c-a721-e817f002b5a2-data-volume" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211913    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="134db473-2a39-4577-861a-09778c502691" volumeName="kubernetes.io/projected/134db473-2a39-4577-861a-09778c502691-kube-api-access-b62lf" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211931    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211944    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.211955    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212020    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212035    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212076    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab6242e1-e200-4ca0-be72-7eb7a46e8ee0" volumeName="kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212089    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb" volumeName="kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-tmp" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212101    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="72812209-4f7e-4e07-8b12-e2271ad4470f" volumeName="kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212114    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-client-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212125    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bb1395d-e068-4d07-a218-971ffb972271" volumeName="kubernetes.io/projected/2bb1395d-e068-4d07-a218-971ffb972271-kube-api-access-9g77m" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212136    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3201fe70-508e-4bba-8ad4-79a9f33a7df2" volumeName="kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-tls" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212148    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/configmap/7150c1a0-ddc4-458e-939b-25e28b3a0496-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212161    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/projected/7150c1a0-ddc4-458e-939b-25e28b3a0496-kube-api-access-j5vnv" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212174    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94271eb5-adea-4fe1-a166-baae2421784f" volumeName="kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212186    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f27d0d9e-e2a4-44b2-a181-caefff4bc502" volumeName="kubernetes.io/projected/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kube-api-access-vtgzc" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212197    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f29e62d4-6063-432c-a721-e817f002b5a2" volumeName="kubernetes.io/configmap/f29e62d4-6063-432c-a721-e817f002b5a2-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212210    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bb1395d-e068-4d07-a218-971ffb972271" volumeName="kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-tls" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212223    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212236    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212247    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212259    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212272    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2" volumeName="kubernetes.io/empty-dir/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-tmp-dir" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212284    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212296    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e6fda66-4524-4933-b497-2056bb7ed874" volumeName="kubernetes.io/configmap/4e6fda66-4524-4933-b497-2056bb7ed874-serviceca" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212309    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/empty-dir/7150c1a0-ddc4-458e-939b-25e28b3a0496-tmp" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212323    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94271eb5-adea-4fe1-a166-baae2421784f" volumeName="kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212334    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212356    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a96c523-b3c5-49e5-b785-d6bb59ac17ef" volumeName="kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212369    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a96c523-b3c5-49e5-b785-d6bb59ac17ef" volumeName="kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212380    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212392    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212404    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb" volumeName="kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-tuned" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212417    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/empty-dir/07aedb61-c8c3-48b2-9a23-98fbc418c394-audit-log" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212428    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212439    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cad6579-f0f3-43f5-b522-af8da26ad7b5" volumeName="kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212451    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab6242e1-e200-4ca0-be72-7eb7a46e8ee0" volumeName="kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212466    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4" volumeName="kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cni-binary-copy" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212480    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212491    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212504    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212515    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212527    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" volumeName="kubernetes.io/secret/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212540    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b74b9bd1-8acf-4839-9c82-84baf2e3b636" volumeName="kubernetes.io/secret/b74b9bd1-8acf-4839-9c82-84baf2e3b636-cert" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212551    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212564    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212576    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212588    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212601    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bb1395d-e068-4d07-a218-971ffb972271" volumeName="kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212618    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e6fda66-4524-4933-b497-2056bb7ed874" volumeName="kubernetes.io/projected/4e6fda66-4524-4933-b497-2056bb7ed874-kube-api-access-jsv66" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212629    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212641    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" volumeName="kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-env-overrides" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212748    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212765    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94271eb5-adea-4fe1-a166-baae2421784f" volumeName="kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-binary-copy" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212778    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94271eb5-adea-4fe1-a166-baae2421784f" volumeName="kubernetes.io/projected/94271eb5-adea-4fe1-a166-baae2421784f-kube-api-access-cftgr" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212794    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212808    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4" volumeName="kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-daemon-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212820    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212833    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bb1395d-e068-4d07-a218-971ffb972271" volumeName="kubernetes.io/empty-dir/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-textfile" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212846    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33d580e1-86c1-41a5-b0ed-3c846111d6b4" volumeName="kubernetes.io/configmap/33d580e1-86c1-41a5-b0ed-3c846111d6b4-konnectivity-ca" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212858    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212872    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212885    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212897    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert" seLinuxMountContext=""
Oct 30 18:37:41.212865 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212912    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212924    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212935    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bb1395d-e068-4d07-a218-971ffb972271" volumeName="kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212950    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e958fd3-b9bf-455f-a339-39de790991ee" volumeName="kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212961    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212972    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212983    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.212994    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213006    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213019    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213032    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a02247e5-ec62-447f-906d-8a475609d158" volumeName="kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213045    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab6242e1-e200-4ca0-be72-7eb7a46e8ee0" volumeName="kubernetes.io/empty-dir/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-volume-directive-shadow" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213059    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab6242e1-e200-4ca0-be72-7eb7a46e8ee0" volumeName="kubernetes.io/projected/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-api-access-j29wt" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213074    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213085    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f29e62d4-6063-432c-a721-e817f002b5a2" volumeName="kubernetes.io/projected/f29e62d4-6063-432c-a721-e817f002b5a2-kube-api-access-rg4ws" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213098    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bb1395d-e068-4d07-a218-971ffb972271" volumeName="kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213110    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213123    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07aedb61-c8c3-48b2-9a23-98fbc418c394" volumeName="kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213134    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213147    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab6242e1-e200-4ca0-be72-7eb7a46e8ee0" volumeName="kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213175    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18ac92f9-c17a-4920-9919-1ac0263481e5" volumeName="kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213188    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7150c1a0-ddc4-458e-939b-25e28b3a0496" volumeName="kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213201    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" volumeName="kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-config" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213212    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="986df46a-1438-4ec9-a665-9093589b136f" volumeName="kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213223    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2" volumeName="kubernetes.io/projected/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-kube-api-access-zrmsx" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213234    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213251    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4" volumeName="kubernetes.io/projected/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-kube-api-access-9d6qg" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213264    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="134db473-2a39-4577-861a-09778c502691" volumeName="kubernetes.io/secret/134db473-2a39-4577-861a-09778c502691-metrics-tls" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213276    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33d580e1-86c1-41a5-b0ed-3c846111d6b4" volumeName="kubernetes.io/secret/33d580e1-86c1-41a5-b0ed-3c846111d6b4-agent-certs" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213288    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" volumeName="kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213300    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" volumeName="kubernetes.io/projected/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-kube-api-access-sbcq8" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213312    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a96c523-b3c5-49e5-b785-d6bb59ac17ef" volumeName="kubernetes.io/configmap/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213324    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3201fe70-508e-4bba-8ad4-79a9f33a7df2" volumeName="kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213335    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" volumeName="kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213348    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a96c523-b3c5-49e5-b785-d6bb59ac17ef" volumeName="kubernetes.io/projected/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-kube-api-access-fmljb" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213360    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab6242e1-e200-4ca0-be72-7eb7a46e8ee0" volumeName="kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-metrics-client-ca" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213374    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b74b9bd1-8acf-4839-9c82-84baf2e3b636" volumeName="kubernetes.io/projected/b74b9bd1-8acf-4839-9c82-84baf2e3b636-kube-api-access-2q67r" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213385    6064 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" volumeName="kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213397    6064 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 18:37:41.215712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.213405    6064 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 18:37:41.226037 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.225998    6064 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:41.228184 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.228156    6064 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:41.230612 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.230581    6064 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 18:37:41.232347 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.232321    6064 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 18:37:41.232347 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.232348    6064 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 18:37:41.232527 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.232370    6064 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 18:37:41.232527 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.232416    6064 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 18:37:41.233864 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.233841    6064 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:41.234383 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.234364    6064 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 18:37:41.237404 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.237386    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:37:41.239779 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.239761    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:37:41.243124 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.243109    6064 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 18:37:41.251502 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.251467    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf" exitCode=0
Oct 30 18:37:41.253775 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.253753    6064 generic.go:356] "Generic (PLEG): container finished" podID="2bb1395d-e068-4d07-a218-971ffb972271" containerID="e18711817190c1d46698870b7b30abec89f0d069520b504c5dbb8e67a4a8de6d" exitCode=0
Oct 30 18:37:41.260013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.259995    6064 generic.go:356] "Generic (PLEG): container finished" podID="ac4c4045ca2bfba4a77d13d53f465298" containerID="2c40abe823e3bd91fa10db007db388410ddeacf4b6e8ce22c87cd38d1abcf561" exitCode=0
Oct 30 18:37:41.288533 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.288515    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:37:41.288868 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.288845    6064 generic.go:356] "Generic (PLEG): container finished" podID="85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2" containerID="5b83c9bbd1a51894c81533d3cb911f0bf2ff17797f24b9699cdf2cb4e955947b" exitCode=1
Oct 30 18:37:41.296405 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.296381    6064 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="87299003c5005248b6a95dbe3f1a67fc468265daaaf87d7b795b3a4433991561" exitCode=0
Oct 30 18:37:41.296405 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.296404    6064 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="6287f63272bd1bae3bccc289a3ace3a2f7be7784e4a27df7ca53b43f951f6a74" exitCode=0
Oct 30 18:37:41.296569 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.296414    6064 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="47b4d8f698555be6e624ec2c9f20f65b098012c63eb4c68ac5a8e980d027c9f5" exitCode=0
Oct 30 18:37:41.296569 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.296422    6064 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="fe327bf3ea6e789ee28b2b58b422707e3d22736a2a37a322b17c1c6e83858d0f" exitCode=0
Oct 30 18:37:41.296569 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.296432    6064 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="2ed0f1f279edd982154aedab8a5e577a1a354d464b3e4c5786eeb4a8cebb3085" exitCode=0
Oct 30 18:37:41.296569 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.296440    6064 generic.go:356] "Generic (PLEG): container finished" podID="94271eb5-adea-4fe1-a166-baae2421784f" containerID="5339e220204d9d35189d4aa31d44a713a87f1786136c613ed3fe798dc57519b5" exitCode=0
Oct 30 18:37:41.303093 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.303066    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0" exitCode=0
Oct 30 18:37:41.332212 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.332162    6064 manager.go:324] Recovery completed
Oct 30 18:37:41.332476 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.332458    6064 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 18:37:41.359108 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359087    6064 cpu_manager.go:226] "Starting" policy="none"
Oct 30 18:37:41.359108 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359105    6064 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 18:37:41.359215 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359122    6064 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 18:37:41.359257 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359243    6064 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 18:37:41.359308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359258    6064 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 18:37:41.359308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359274    6064 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 18:37:41.359308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359280    6064 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 18:37:41.359308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359285    6064 policy_none.go:50] "Start"
Oct 30 18:37:41.359308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359294    6064 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 18:37:41.359308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359303    6064 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 18:37:41.359461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359423    6064 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 18:37:41.359461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359430    6064 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 18:37:41.359461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.359435    6064 policy_none.go:44] "Start"
Oct 30 18:37:41.364283 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.364246    6064 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 18:37:41.368187 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.368173    6064 manager.go:341] "Starting Device Plugin manager"
Oct 30 18:37:41.368647 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.368201    6064 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 18:37:41.368647 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.368665    6064 server.go:87] "Starting device plugin registration server"
Oct 30 18:37:41.368983 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.368967    6064 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 18:37:41.369062 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.368983    6064 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 18:37:41.369114 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.369071    6064 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 18:37:41.369200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.369161    6064 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 18:37:41.369297 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.369205    6064 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 18:37:41.369297 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.369213    6064 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 18:37:41.369416 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.369256    6064 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:37:41.369194884Z","UUID":"4db996a7-5c85-493a-bb33-aada07ba0e69","Handler":null,"Name":"","Endpoint":""}
Oct 30 18:37:41.370601 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.370582    6064 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 18:37:41.370699 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.370612    6064 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 18:37:41.371043 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.371023    6064 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 18:37:41.469926 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.469904    6064 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 18:37:41.471779 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.471759    6064 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 18:37:41.471863 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.471791    6064 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 18:37:41.471863 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.471804    6064 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-34.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 18:37:41.471863 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.471857    6064 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.500876 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.500859    6064 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.500944 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.500914    6064 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.533605 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.533569    6064 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"]
Oct 30 18:37:41.534180 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534157    6064 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.534273 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534152    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"5556c3ea4229dba8b9cd7852950cab95","Type":"ContainerStarted","Data":"ae2111a3db5262e5198570952340c69216261db2872bf622a0df39cd631e915d"}
Oct 30 18:37:41.534330 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534309    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"5556c3ea4229dba8b9cd7852950cab95","Type":"ContainerStarted","Data":"aee335f9418fa5f04ce3e5dc556262287a2c0e30a8049c0f45b3314dd99cae1d"}
Oct 30 18:37:41.534330 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534323    6064 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.534436 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534338    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"ac4c4045ca2bfba4a77d13d53f465298","Type":"ContainerStarted","Data":"7bcdb52b96353423cbdbbfc7f97f43cbc16795713469020c886e3181d0f888ce"}
Oct 30 18:37:41.534436 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534363    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"ac4c4045ca2bfba4a77d13d53f465298","Type":"ContainerDied","Data":"2c40abe823e3bd91fa10db007db388410ddeacf4b6e8ce22c87cd38d1abcf561"}
Oct 30 18:37:41.534436 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.534382    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal" event={"ID":"ac4c4045ca2bfba4a77d13d53f465298","Type":"ContainerStarted","Data":"bd13d9e04783e5cfcf56d118dbce0d066a9f42bdcb2037729ca4c5903de54d50"}
Oct 30 18:37:41.557300 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.557278    6064 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:37:41.557361 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.557312    6064 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.562461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.562443    6064 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:37:41.562533 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:41.562481    6064 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.635747 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.635722    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.635836 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.635752    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.635836 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.635770    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5556c3ea4229dba8b9cd7852950cab95-config\") pod \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"5556c3ea4229dba8b9cd7852950cab95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.736168 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.736142    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.736255 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.736170    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.736255 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.736188    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5556c3ea4229dba8b9cd7852950cab95-config\") pod \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"5556c3ea4229dba8b9cd7852950cab95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.736255 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.736226    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5556c3ea4229dba8b9cd7852950cab95-config\") pod \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"5556c3ea4229dba8b9cd7852950cab95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.736367 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.736262    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:41.736367 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:41.736262    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac4c4045ca2bfba4a77d13d53f465298-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" (UID: \"ac4c4045ca2bfba4a77d13d53f465298\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:42.187275 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.187248    6064 apiserver.go:52] "Watching apiserver"
Oct 30 18:37:42.195811 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.195789    6064 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 18:37:42.196603 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.196572    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pdp2x","openshift-multus/multus-bs7gv","openshift-image-registry/node-ca-9xmbq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-8rnfp","openshift-console/console-556db5d9b4-9fjwk","openshift-monitoring/prometheus-k8s-0","openshift-network-diagnostics/network-check-target-gw4w2","kube-system/global-pull-secret-syncer-mr8gw","openshift-multus/network-metrics-daemon-mng5f","openshift-dns/dns-default-wphqb","openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj","openshift-monitoring/metrics-server-64bc79665d-fthpb","openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf","openshift-ovn-kubernetes/ovnkube-node-d7958","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg","openshift-dns/node-resolver-778wz","openshift-monitoring/node-exporter-tjg84","kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal","openshift-insights/insights-runtime-extractor-kkds7","openshift-monitoring/alertmanager-main-0","openshift-monitoring/prometheus-operator-9cd89b74c-drcmf","openshift-console/console-6b7cd7686f-fzssr","openshift-ingress-canary/ingress-canary-6dqls","openshift-console/console-7cdff48494-95kkl","kube-system/konnectivity-agent-kj7ts","openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq","openshift-multus/multus-additional-cni-plugins-mbn4h"]
Oct 30 18:37:42.229196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.229163    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.229339 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.229203    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.229339 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.229309    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.229436 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.229378    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.229854 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.229828    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.229956 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.229884    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.230436 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230415    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.230436 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230426    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 18:37:42.230601 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230449    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.230601 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230450    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.230601 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230470    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.230601 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230587    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 18:37:42.230829 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230633    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.230829 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230741    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 18:37:42.230829 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230762    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.230829 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.230781    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 18:37:42.231193 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.231173    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.231303 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.231255    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 18:37:42.231370 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.231348    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 18:37:42.231502 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.231475    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 18:37:42.231615 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.231598    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.231837 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.231815    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 18:37:42.232106 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232087    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.232322 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232305    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 18:37:42.232375 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232358    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.232705 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232689    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 18:37:42.232758 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232702    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 18:37:42.232814 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232775    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 18:37:42.232814 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232807    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 18:37:42.232914 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232836    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.232914 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232841    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 18:37:42.232914 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.232871    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.234703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.234639    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 18:37:42.234876 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.234861    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 18:37:42.235381 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.235356    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 18:37:42.235633 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.235604    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.235728 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.235706    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.235795 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.235773    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 18:37:42.235986 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.235973    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.236053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.235977    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 18:37:42.236053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.236041    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 18:37:42.237597 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.237574    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 18:37:42.237952 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.237933    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 18:37:42.238108 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238083    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-socket-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.238187 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238127    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.238187 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238162    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-kubelet\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.238309 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238193    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-netd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.238309 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238229    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.238309 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238265    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-config\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.238309 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238289    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.238469 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238322    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.238469 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238353    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-slash\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.238469 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238412    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:42.238606 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238445    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-registration-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.238606 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238569    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cftgr\" (UniqueName: \"kubernetes.io/projected/94271eb5-adea-4fe1-a166-baae2421784f-kube-api-access-cftgr\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.238827 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238804    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 18:37:42.238947 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238921    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-config\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239009 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238932    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-systemd-units\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239060 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.238973    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-systemd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239107 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239064    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-etc-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239201 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239177    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-ovn\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239264 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239228    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-node-log\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239315 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239275    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 18:37:42.239315 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239267    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsv66\" (UniqueName: \"kubernetes.io/projected/4e6fda66-4524-4933-b497-2056bb7ed874-kube-api-access-jsv66\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.239405 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239368    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 18:37:42.239405 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239391    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab645310-3a44-4917-ab17-6f4a9e26763b-iptables-alerter-script\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.239508 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239396    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 18:37:42.239508 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239452    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-log-socket\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239508 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239480    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 18:37:42.239508 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239499    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtgzc\" (UniqueName: \"kubernetes.io/projected/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kube-api-access-vtgzc\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.239716 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239517    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.239716 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239555    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-cnibin\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.239716 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239627    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.239841 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239717    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d580e1-86c1-41a5-b0ed-3c846111d6b4-agent-certs\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:37:42.239841 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239740    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab645310-3a44-4917-ab17-6f4a9e26763b-iptables-alerter-script\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.239841 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239751    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239930 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239851    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.239930 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239898    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.239930 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239925    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.240012 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239945    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-sys-fs\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.240012 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.239987    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-system-cni-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.240069 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240026    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-script-lib\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240069 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240054    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.240162 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240117    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-device-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.240205 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240131    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 18:37:42.240243 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240207    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-var-lib-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240300 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240258    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d580e1-86c1-41a5-b0ed-3c846111d6b4-konnectivity-ca\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:37:42.240300 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240284    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovnkube-script-lib\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240382 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240336    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-netns\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240462 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240445    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-bin\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240511 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240459    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33d580e1-86c1-41a5-b0ed-3c846111d6b4-konnectivity-ca\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:37:42.240562 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240519    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-env-overrides\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240610 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240590    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovn-node-metrics-cert\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240687 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240615    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbcq8\" (UniqueName: \"kubernetes.io/projected/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-kube-api-access-sbcq8\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.240687 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240636    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e6fda66-4524-4933-b497-2056bb7ed874-host\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.241036 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.240703    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e6fda66-4524-4933-b497-2056bb7ed874-serviceca\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.241135 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.241061    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab645310-3a44-4917-ab17-6f4a9e26763b-host-slash\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.241135 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.241118    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4xzz\" (UniqueName: \"kubernetes.io/projected/ab645310-3a44-4917-ab17-6f4a9e26763b-kube-api-access-d4xzz\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.241227 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.241137    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-env-overrides\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.241672 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.241635    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e6fda66-4524-4933-b497-2056bb7ed874-serviceca\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.248806 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.248781    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.249112 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.249058    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94271eb5-adea-4fe1-a166-baae2421784f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.276281 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.276257    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtgzc\" (UniqueName: \"kubernetes.io/projected/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kube-api-access-vtgzc\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.283550 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.283365    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4xzz\" (UniqueName: \"kubernetes.io/projected/ab645310-3a44-4917-ab17-6f4a9e26763b-kube-api-access-d4xzz\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.283550 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.283476    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cftgr\" (UniqueName: \"kubernetes.io/projected/94271eb5-adea-4fe1-a166-baae2421784f-kube-api-access-cftgr\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.285196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.283622    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 18:37:42.285196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.283723    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zz6bl\""
Oct 30 18:37:42.285196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.283819    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 18:37:42.285196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.283879    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-psdnm\""
Oct 30 18:37:42.285196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.284313    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfzz\" (UniqueName: \"kubernetes.io/projected/2cad6579-f0f3-43f5-b522-af8da26ad7b5-kube-api-access-jbfzz\") pod \"network-check-target-gw4w2\" (UID: \"2cad6579-f0f3-43f5-b522-af8da26ad7b5\") " pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:42.285468 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.285452    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 18:37:42.285534 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.285490    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 18:37:42.285604 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.285573    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-75g8c\""
Oct 30 18:37:42.285712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.285691    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 18:37:42.285832 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.285815    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 18:37:42.285888 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.285869    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rwngh\""
Oct 30 18:37:42.286555 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.286523    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4k7wf\""
Oct 30 18:37:42.286555 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.286533    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 18:37:42.286555 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.286545    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2njn\""
Oct 30 18:37:42.287096 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287068    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mkp5v\""
Oct 30 18:37:42.287222 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287191    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 18:37:42.287317 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287234    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdfmc\""
Oct 30 18:37:42.287363 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287316    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 18:37:42.287363 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287334    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-whw2z\""
Oct 30 18:37:42.287898 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287879    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 18:37:42.287972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287880    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 18:37:42.287972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.287926    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 18:37:42.288082 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288014    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:37:42.288133 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288108    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 18:37:42.288185 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288137    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 18:37:42.288185 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288156    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 18:37:42.288279 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288248    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 18:37:42.288279 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288253    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 18:37:42.288279 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288261    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 18:37:42.288407 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288282    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 18:37:42.288407 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288392    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 18:37:42.288512 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288412    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 18:37:42.288562 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288533    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-x9qkh\""
Oct 30 18:37:42.288562 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288537    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 18:37:42.288675 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288579    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-58z5f\""
Oct 30 18:37:42.288675 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288596    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r4rtj\""
Oct 30 18:37:42.288675 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288540    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 18:37:42.288808 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288698    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 18:37:42.288808 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288802    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 18:37:42.288908 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288823    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 18:37:42.288956 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288910    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 18:37:42.288956 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288937    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 18:37:42.288956 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288943    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288960    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vs59c\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288972    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5jr2c\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288994    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dshdk\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288910    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289043    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r9gnp\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.288996    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289076    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0huhn2rtoft9\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289090    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-829tl\""
Oct 30 18:37:42.289099 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289099    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 18:37:42.289354 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289103    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 18:37:42.289354 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289045    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 18:37:42.289354 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289110    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ntkxb\""
Oct 30 18:37:42.289354 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289122    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jfgwk\""
Oct 30 18:37:42.289523 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289506    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 18:37:42.289574 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289552    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsv66\" (UniqueName: \"kubernetes.io/projected/4e6fda66-4524-4933-b497-2056bb7ed874-kube-api-access-jsv66\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.289628 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.289617    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mrncz\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.290320    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kfsqx\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.290367    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.290440    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.290926    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbcq8\" (UniqueName: \"kubernetes.io/projected/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-kube-api-access-sbcq8\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291061    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bbfb8bpjur100\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291103    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291187    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxh65\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291224    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ts4zm\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291279    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291315    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gmwpq\""
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291516    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33d580e1-86c1-41a5-b0ed-3c846111d6b4-agent-certs\") pod \"konnectivity-agent-kj7ts\" (UID: \"33d580e1-86c1-41a5-b0ed-3c846111d6b4\") " pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:37:42.291805 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.291775    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-ovn-node-metrics-cert\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.292214 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.292186    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 18:37:42.294466 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.294450    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3gji7s0vk8526\""
Oct 30 18:37:42.299111 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.299092    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 18:37:42.306002 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.305983    6064 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 18:37:42.308318 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.308303    6064 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:42.308489 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.308473    6064 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:42.330373 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.330349    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 18:37:42.342066 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342041    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6bn\" (UniqueName: \"kubernetes.io/projected/3201fe70-508e-4bba-8ad4-79a9f33a7df2-kube-api-access-rz6bn\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.342151 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342070    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.342151 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342092    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342151 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342108    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-sys-fs\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.342151 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342123    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-system-cni-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342159    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-tmp-dir\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342183    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29e62d4-6063-432c-a721-e817f002b5a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342205    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342226    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342230    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-sys-fs\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342252    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-etc-kubernetes\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342299    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmljb\" (UniqueName: \"kubernetes.io/projected/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-kube-api-access-fmljb\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342322    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342340    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342363    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342380    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342388    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342398    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-var-lib-kubelet\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342421    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342423    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342478    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-tmp-dir\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342482    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342543    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342585    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342586    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f29e62d4-6063-432c-a721-e817f002b5a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342230    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-system-cni-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342588    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342621    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342693    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342759    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.342799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342773    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342842    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342869    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342914    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.342949    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343045    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343065    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343085    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343126    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-slash\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343155    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29e62d4-6063-432c-a721-e817f002b5a2-data-volume\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343172    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343180    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e958fd3-b9bf-455f-a339-39de790991ee-metrics-certs\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343191    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343204    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343227    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-slash\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343242    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-node-log\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343241    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f29e62d4-6063-432c-a721-e817f002b5a2-data-volume\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343277    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-node-log\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343272    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-tmp\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343319    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-hosts-file\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343329    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-tmp\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343347    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343384    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343424    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343438    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-kubelet-config\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343434    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343448    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343461    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343495    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-metrics-server-audit-profiles\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343532    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-log-socket\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343574    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-kubernetes\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.343589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343601    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9j4b\" (UniqueName: \"kubernetes.io/projected/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-kube-api-access-r9j4b\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343627    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343627    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-log-socket\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343694    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343770    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343795    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-metrics-server-audit-profiles\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343807    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343800    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/134db473-2a39-4577-861a-09778c502691-tmp-dir\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343844    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343859    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/134db473-2a39-4577-861a-09778c502691-tmp-dir\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343869    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343895    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-k8s-cni-cncf-io\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343923    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343958    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.343961    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344004    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344096    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344128    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-run\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344100    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344151    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344162    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344155    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344220    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344246    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7150c1a0-ddc4-458e-939b-25e28b3a0496-tmp\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344290    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07aedb61-c8c3-48b2-9a23-98fbc418c394-audit-log\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344343    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7150c1a0-ddc4-458e-939b-25e28b3a0496-tmp\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344359    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-netns\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344359    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344384    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-bin\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344420    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344425    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-run-netns\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344425    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-bin\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344384    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07aedb61-c8c3-48b2-9a23-98fbc418c394-audit-log\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344429    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344486    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344547    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-grpc-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344576    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-netd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344597    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344606    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysconfig\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344610    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344630    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-netns\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344675    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-cni-netd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344689    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344727    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344787    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qxzj\" (UniqueName: \"kubernetes.io/projected/3e958fd3-b9bf-455f-a339-39de790991ee-kube-api-access-4qxzj\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344832    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344837    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d6qg\" (UniqueName: \"kubernetes.io/projected/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-kube-api-access-9d6qg\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344853    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-grpc-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344863    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344889    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344912    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344937    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-systemd-units\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.344980    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345007    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-systemd-units\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345018    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-systemd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345019    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345046    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-etc-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345076    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-systemd\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345081    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-etc-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345094    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.345086 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345130    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345157    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3201fe70-508e-4bba-8ad4-79a9f33a7df2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345238    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345312    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3201fe70-508e-4bba-8ad4-79a9f33a7df2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345363    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345401    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345450    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/134db473-2a39-4577-861a-09778c502691-metrics-tls\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345476    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29e62d4-6063-432c-a721-e817f002b5a2-crio-socket\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345509    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345533    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74b9bd1-8acf-4839-9c82-84baf2e3b636-cert\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345557    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345575    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345586    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345627    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345676    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-sys\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345705    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-textfile\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345730    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345755    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345780    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-device-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345805    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-wtmp\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345831    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345854    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7150c1a0-ddc4-458e-939b-25e28b3a0496-metrics-client-ca\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345880    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-sys\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345904    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-lib-modules\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345928    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cni-binary-copy\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345936    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345951    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.345978    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346002    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346032    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346057    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346079    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cnibin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346105    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346117    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346148    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-tls\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346174    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346199    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346221    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346244    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-modprobe-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346265    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-multus\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346286    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-hostroot\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346311    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346315    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b74b9bd1-8acf-4839-9c82-84baf2e3b636-cert\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346336    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346360    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-registration-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346380    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346384    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-daemon-config\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346424    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g77m\" (UniqueName: \"kubernetes.io/projected/2bb1395d-e068-4d07-a218-971ffb972271-kube-api-access-9g77m\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346452    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vnv\" (UniqueName: \"kubernetes.io/projected/7150c1a0-ddc4-458e-939b-25e28b3a0496-kube-api-access-j5vnv\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346479    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-tls\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346507    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-tuned\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346536    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346555    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-daemon-config\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346563    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-client-certs\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346595    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/134db473-2a39-4577-861a-09778c502691-config-volume\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346620    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-cnibin\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346681    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346705    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346727    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346751    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346777    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-multus-certs\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346781    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-client-certs\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346802    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346827    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346853    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346878    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346903    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q67r\" (UniqueName: \"kubernetes.io/projected/b74b9bd1-8acf-4839-9c82-84baf2e3b636-kube-api-access-2q67r\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346929    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b62lf\" (UniqueName: \"kubernetes.io/projected/134db473-2a39-4577-861a-09778c502691-kube-api-access-b62lf\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346954    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-var-lib-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.346977    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-socket-dir-parent\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347068    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-bin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347092    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-kubelet\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347118    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg4ws\" (UniqueName: \"kubernetes.io/projected/f29e62d4-6063-432c-a721-e817f002b5a2-kube-api-access-rg4ws\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347143    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-metrics-client-ca\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347170    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347196    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e6fda66-4524-4933-b497-2056bb7ed874-host\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347227    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347256    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347289    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab645310-3a44-4917-ab17-6f4a9e26763b-host-slash\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347314    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-socket-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347339    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-kubelet\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347367    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347395    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-system-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347421    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-conf-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347444    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-secret-metrics-server-tls\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347449    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29e62d4-6063-432c-a721-e817f002b5a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347511    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmsx\" (UniqueName: \"kubernetes.io/projected/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-kube-api-access-zrmsx\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347542    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347570    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347598    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-root\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347626    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347633    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f29e62d4-6063-432c-a721-e817f002b5a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347675    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347707    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347735    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-ovn\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347761    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-conf\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347787    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-host\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347815    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-dbus\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347818    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07aedb61-c8c3-48b2-9a23-98fbc418c394-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347842    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347873    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347900    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-client-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347930    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29nn2\" (UniqueName: \"kubernetes.io/projected/07aedb61-c8c3-48b2-9a23-98fbc418c394-kube-api-access-29nn2\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347959    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.347987    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348010    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/134db473-2a39-4577-861a-09778c502691-metrics-tls\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.347982 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348014    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348070    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j29wt\" (UniqueName: \"kubernetes.io/projected/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-api-access-j29wt\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348098    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348129    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348157    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348186    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348218    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-systemd\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348429    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-tuned\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348558    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348629    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348684    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-textfile\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348832    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.348962    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349007    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349042    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349072    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349166    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349319    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-metrics-client-ca\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349328    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349372    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349538    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349575    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349597    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e6fda66-4524-4933-b497-2056bb7ed874-host\") pod \"node-ca-9xmbq\" (UID: \"4e6fda66-4524-4933-b497-2056bb7ed874\") " pod="openshift-image-registry/node-ca-9xmbq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349605    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349636    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-var-lib-openvswitch\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349642    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-run-ovn\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349827    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349838    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349839    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349890    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab645310-3a44-4917-ab17-6f4a9e26763b-host-slash\") pod \"iptables-alerter-pdp2x\" (UID: \"ab645310-3a44-4917-ab17-6f4a9e26763b\") " pod="openshift-network-operator/iptables-alerter-pdp2x"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349914    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349925    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-socket-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.349990    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350003    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350060    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350105    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2-host-kubelet\") pod \"ovnkube-node-d7958\" (UID: \"85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350172    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350229    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-tls\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350229    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350241    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-device-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350355    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07aedb61-c8c3-48b2-9a23-98fbc418c394-client-ca-bundle\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350399    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3201fe70-508e-4bba-8ad4-79a9f33a7df2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350427    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350443    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94271eb5-adea-4fe1-a166-baae2421784f-cnibin\") pod \"multus-additional-cni-plugins-mbn4h\" (UID: \"94271eb5-adea-4fe1-a166-baae2421784f\") " pod="openshift-multus/multus-additional-cni-plugins-mbn4h"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350555    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f27d0d9e-e2a4-44b2-a181-caefff4bc502-registration-dir\") pod \"aws-ebs-csi-driver-node-7svjg\" (UID: \"f27d0d9e-e2a4-44b2-a181-caefff4bc502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svjg"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350561    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350647    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350717    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350777    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/134db473-2a39-4577-861a-09778c502691-config-volume\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350799    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-tls\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350864    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350872    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350957    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.350991    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cni-binary-copy\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351018    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351044    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351045    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351125    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7150c1a0-ddc4-458e-939b-25e28b3a0496-metrics-client-ca\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351184    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7150c1a0-ddc4-458e-939b-25e28b3a0496-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351346    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351346    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72812209-4f7e-4e07-8b12-e2271ad4470f-original-pull-secret\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351478    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351547    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.352415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.351741    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.358107 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.358089    6064 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:37:42.358212 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:42.358142    6064 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:42.390856 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.390823    6064 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 18:37:42.390999 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:42.390883    6064 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-34.us-east-2.compute.internal"
Oct 30 18:37:42.401955 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.401934    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qxzj\" (UniqueName: \"kubernetes.io/projected/3e958fd3-b9bf-455f-a339-39de790991ee-kube-api-access-4qxzj\") pod \"network-metrics-daemon-mng5f\" (UID: \"3e958fd3-b9bf-455f-a339-39de790991ee\") " pod="openshift-multus/network-metrics-daemon-mng5f"
Oct 30 18:37:42.402047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.401955    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6bn\" (UniqueName: \"kubernetes.io/projected/3201fe70-508e-4bba-8ad4-79a9f33a7df2-kube-api-access-rz6bn\") pod \"prometheus-operator-9cd89b74c-drcmf\" (UID: \"3201fe70-508e-4bba-8ad4-79a9f33a7df2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-drcmf"
Oct 30 18:37:42.404390 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.404372    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d6qg\" (UniqueName: \"kubernetes.io/projected/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-kube-api-access-9d6qg\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.407301 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.407284    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmljb\" (UniqueName: \"kubernetes.io/projected/9a96c523-b3c5-49e5-b785-d6bb59ac17ef-kube-api-access-fmljb\") pod \"openshift-state-metrics-7bd7489957-kpvwf\" (UID: \"9a96c523-b3c5-49e5-b785-d6bb59ac17ef\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-kpvwf"
Oct 30 18:37:42.407391 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.407374    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") pod \"console-556db5d9b4-9fjwk\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") " pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:42.427837 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.427813    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9j4b\" (UniqueName: \"kubernetes.io/projected/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-kube-api-access-r9j4b\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.427988 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.427974    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") pod \"console-6b7cd7686f-fzssr\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") " pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.428269 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.428253    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") pod \"console-7cdff48494-95kkl\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") " pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:37:42.434145 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.434120    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g77m\" (UniqueName: \"kubernetes.io/projected/2bb1395d-e068-4d07-a218-971ffb972271-kube-api-access-9g77m\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.434476 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.434456    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vnv\" (UniqueName: \"kubernetes.io/projected/7150c1a0-ddc4-458e-939b-25e28b3a0496-kube-api-access-j5vnv\") pod \"thanos-querier-55d5bb77c5-jvkpq\" (UID: \"7150c1a0-ddc4-458e-939b-25e28b3a0496\") " pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:42.435565 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.435547    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmsx\" (UniqueName: \"kubernetes.io/projected/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-kube-api-access-zrmsx\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.436141 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.436116    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29nn2\" (UniqueName: \"kubernetes.io/projected/07aedb61-c8c3-48b2-9a23-98fbc418c394-kube-api-access-29nn2\") pod \"metrics-server-64bc79665d-fthpb\" (UID: \"07aedb61-c8c3-48b2-9a23-98fbc418c394\") " pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:37:42.440024 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.439980    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q67r\" (UniqueName: \"kubernetes.io/projected/b74b9bd1-8acf-4839-9c82-84baf2e3b636-kube-api-access-2q67r\") pod \"ingress-canary-6dqls\" (UID: \"b74b9bd1-8acf-4839-9c82-84baf2e3b636\") " pod="openshift-ingress-canary/ingress-canary-6dqls"
Oct 30 18:37:42.441243 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.441222    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg4ws\" (UniqueName: \"kubernetes.io/projected/f29e62d4-6063-432c-a721-e817f002b5a2-kube-api-access-rg4ws\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.444200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.444183    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") pod \"prometheus-k8s-0\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:42.444398 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.444383    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b62lf\" (UniqueName: \"kubernetes.io/projected/134db473-2a39-4577-861a-09778c502691-kube-api-access-b62lf\") pod \"dns-default-wphqb\" (UID: \"134db473-2a39-4577-861a-09778c502691\") " pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.445812 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.445790    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") pod \"alertmanager-main-0\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:37:42.448554 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448533    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysconfig\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.448637 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448561    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-netns\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.448637 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448583    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29e62d4-6063-432c-a721-e817f002b5a2-crio-socket\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.448637 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448619    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-sys\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448648    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f29e62d4-6063-432c-a721-e817f002b5a2-crio-socket\") pod \"insights-runtime-extractor-kkds7\" (UID: \"f29e62d4-6063-432c-a721-e817f002b5a2\") " pod="openshift-insights/insights-runtime-extractor-kkds7"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448648    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-netns\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448674    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-wtmp\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448709    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-sys\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448716    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-node-exporter-wtmp\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448717    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysconfig\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448733    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-lib-modules\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448745    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-sys\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448762    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448766    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-sys\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448785    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cnibin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.448813 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448810    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-modprobe-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448823    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-lib-modules\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448867    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-multus\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448887    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-modprobe-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448888    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-cnibin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448889    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-hostroot\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448928    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-hostroot\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448896    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-multus\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448866    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-d\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.448970    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-multus-certs\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449003    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-socket-dir-parent\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449028    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-bin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449051    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-kubelet\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449065    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-multus-certs\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449079    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-cni-bin\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449085    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-system-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449101    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-var-lib-kubelet\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449109    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-conf-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449079    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-socket-dir-parent\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449138    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-root\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449173    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bb1395d-e068-4d07-a218-971ffb972271-root\") pod \"node-exporter-tjg84\" (UID: \"2bb1395d-e068-4d07-a218-971ffb972271\") " pod="openshift-monitoring/node-exporter-tjg84"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449153    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-conf-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449186    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-conf\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449188    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-system-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449220    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-host\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449246    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-dbus\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449253    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-host\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449273    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449288    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-sysctl-conf\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449302    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-systemd\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449308    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-dbus\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449323    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-multus-cni-dir\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.449316 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449333    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-etc-kubernetes\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449360    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-var-lib-kubelet\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449371    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-systemd\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449389    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-etc-kubernetes\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449397    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-hosts-file\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449421    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-kubelet-config\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449447    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-kubernetes\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449487    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2-hosts-file\") pod \"node-resolver-778wz\" (UID: \"ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2\") " pod="openshift-dns/node-resolver-778wz"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449501    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72812209-4f7e-4e07-8b12-e2271ad4470f-kubelet-config\") pod \"global-pull-secret-syncer-mr8gw\" (UID: \"72812209-4f7e-4e07-8b12-e2271ad4470f\") " pod="kube-system/global-pull-secret-syncer-mr8gw"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449507    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-etc-kubernetes\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449527    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-k8s-cni-cncf-io\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449508    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-var-lib-kubelet\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449552    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4-host-run-k8s-cni-cncf-io\") pod \"multus-bs7gv\" (UID: \"bf3c9b69-ac58-4a89-9c4c-0a7484f4b2c4\") " pod="openshift-multus/multus-bs7gv"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449560    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-run\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.450552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.449635    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb-run\") pod \"tuned-8rnfp\" (UID: \"30d1b1ed-1235-4ed3-b6ab-2eadd1c17cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-8rnfp"
Oct 30 18:37:42.458469 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.455937    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29wt\" (UniqueName: \"kubernetes.io/projected/ab6242e1-e200-4ca0-be72-7eb7a46e8ee0-kube-api-access-j29wt\") pod \"kube-state-metrics-5dc8d7d89b-krztj\" (UID: \"ab6242e1-e200-4ca0-be72-7eb7a46e8ee0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-krztj"
Oct 30 18:37:42.673914 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.673877    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.678467 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.678441    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:42.736481 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.736417    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wphqb"
Oct 30 18:37:42.865037 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:42.865002    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556db5d9b4-9fjwk"]
Oct 30 18:37:43.977746 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:43.977714    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:37:44.633736 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:44.633702    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55d5bb77c5-jvkpq"
Oct 30 18:37:45.091337 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:45.091314    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:37:47.187638 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:47.187606    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:37:47.584401 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:47.584367    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:47.595868 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:47.595843    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:48.716456 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:48.716426    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:37:48.716912 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:48.716691    6064 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 18:37:53.060586 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:37:53.060508    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:37:57.589250 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:57.589221    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:37:57.700278 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:37:57.700248    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64bc79665d-fthpb"
Oct 30 18:38:02.565817 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:02.565785    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kj7ts"
Oct 30 18:38:03.503216 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503185    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:03.503495 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503446    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="alertmanager" containerID="cri-o://842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c" gracePeriod=120
Oct 30 18:38:03.503635 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503493    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="config-reloader" containerID="cri-o://984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941" gracePeriod=120
Oct 30 18:38:03.503635 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503501    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-metric" containerID="cri-o://810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5" gracePeriod=120
Oct 30 18:38:03.503635 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503470    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="prom-label-proxy" containerID="cri-o://c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009" gracePeriod=120
Oct 30 18:38:03.503635 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503514    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-web" containerID="cri-o://de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a" gracePeriod=120
Oct 30 18:38:03.503874 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:03.503467    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy" containerID="cri-o://7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3" gracePeriod=120
Oct 30 18:38:04.394942 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.394903    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009" exitCode=0
Oct 30 18:38:04.394942 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.394932    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5" exitCode=0
Oct 30 18:38:04.394942 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.394939    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3" exitCode=0
Oct 30 18:38:04.394942 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.394948    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941" exitCode=0
Oct 30 18:38:04.394942 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.394954    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c" exitCode=0
Oct 30 18:38:04.395441 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.394972    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009"}
Oct 30 18:38:04.395441 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.395067    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5"}
Oct 30 18:38:04.395441 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.395095    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3"}
Oct 30 18:38:04.395441 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.395120    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941"}
Oct 30 18:38:04.395441 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.395145    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c"}
Oct 30 18:38:04.787042 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.787019    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:04.845480 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845447    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845480 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845483    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845505    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845541    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845563    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845594    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845624    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.845715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845669    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845722    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845755    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845792    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845854    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845888    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") pod \"18ac92f9-c17a-4920-9919-1ac0263481e5\" (UID: \"18ac92f9-c17a-4920-9919-1ac0263481e5\") "
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845892    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:04.846045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.845963    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:04.846410 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.846203    6064 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.846410 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.846231    6064 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ac92f9-c17a-4920-9919-1ac0263481e5-metrics-client-ca\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.847106 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.846530    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:04.849196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.849167    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.849505 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.849476    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:04.849715 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.849692    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.849881 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.849856    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:04.850904 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.850865    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "kube-api-access-l8wd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:04.851252 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.851220    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.851382 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.851335    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.851544 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.851523    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.855901 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.855811    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.862482 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.862452    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config" pod "18ac92f9-c17a-4920-9919-1ac0263481e5" (UID: "18ac92f9-c17a-4920-9919-1ac0263481e5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:04.946679 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946614    6064 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-tls-assets\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946679 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946638    6064 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-alertmanager-main-db\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946679 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946649    6064 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-main-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946679 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946680    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8wd4\" (UniqueName: \"kubernetes.io/projected/18ac92f9-c17a-4920-9919-1ac0263481e5-kube-api-access-l8wd4\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946692    6064 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946723    6064 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-web-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946733    6064 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946743    6064 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-cluster-tls-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946752    6064 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946762    6064 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ac92f9-c17a-4920-9919-1ac0263481e5-config-out\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:04.946862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:04.946770    6064 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/18ac92f9-c17a-4920-9919-1ac0263481e5-config-volume\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:05.402520 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.402486    6064 generic.go:356] "Generic (PLEG): container finished" podID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerID="de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a" exitCode=0
Oct 30 18:38:05.402901 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.402569    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.402901 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.402572    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a"}
Oct 30 18:38:05.402901 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.402647    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"18ac92f9-c17a-4920-9919-1ac0263481e5","Type":"ContainerDied","Data":"f12d3d21b117e3337d08051175d58d21e9ece75f054cc7aa6c542ad3bc20383c"}
Oct 30 18:38:05.402901 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.402677    6064 scope.go:122] "RemoveContainer" containerID="c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009"
Oct 30 18:38:05.411663 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.411632    6064 scope.go:122] "RemoveContainer" containerID="810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5"
Oct 30 18:38:05.419351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.419335    6064 scope.go:122] "RemoveContainer" containerID="7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3"
Oct 30 18:38:05.426382 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.426357    6064 scope.go:122] "RemoveContainer" containerID="de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a"
Oct 30 18:38:05.432983 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.432969    6064 scope.go:122] "RemoveContainer" containerID="984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941"
Oct 30 18:38:05.438301 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.438278    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:05.441033 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.441011    6064 scope.go:122] "RemoveContainer" containerID="842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c"
Oct 30 18:38:05.443442 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.443417    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:05.468762 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.468741    6064 scope.go:122] "RemoveContainer" containerID="9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0"
Oct 30 18:38:05.476350 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.476324    6064 scope.go:122] "RemoveContainer" containerID="c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009"
Oct 30 18:38:05.476587 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.476563    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009\": container with ID starting with c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009 not found: ID does not exist" containerID="c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009"
Oct 30 18:38:05.476635 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.476593    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009"} err="failed to get container status \"c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009\": rpc error: code = NotFound desc = could not find container \"c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009\": container with ID starting with c9fe2e08666410e30775cba6394e38c957349ae005bcbd358f9474ad708b8009 not found: ID does not exist"
Oct 30 18:38:05.476635 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.476623    6064 scope.go:122] "RemoveContainer" containerID="810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5"
Oct 30 18:38:05.476917 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.476898    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5\": container with ID starting with 810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5 not found: ID does not exist" containerID="810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5"
Oct 30 18:38:05.476967 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.476924    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5"} err="failed to get container status \"810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5\": rpc error: code = NotFound desc = could not find container \"810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5\": container with ID starting with 810e313a3be8c53e0d484c70a41c499983da9b5bfcc8ed1dbb88ced0195050e5 not found: ID does not exist"
Oct 30 18:38:05.476967 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.476939    6064 scope.go:122] "RemoveContainer" containerID="7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3"
Oct 30 18:38:05.477279 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.477253    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3\": container with ID starting with 7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3 not found: ID does not exist" containerID="7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3"
Oct 30 18:38:05.477355 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.477289    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3"} err="failed to get container status \"7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3\": rpc error: code = NotFound desc = could not find container \"7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3\": container with ID starting with 7097785f39a4c40f942293ffa7597cd274e5b6d3e84892986a4564e0444dbdd3 not found: ID does not exist"
Oct 30 18:38:05.477355 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.477309    6064 scope.go:122] "RemoveContainer" containerID="de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a"
Oct 30 18:38:05.477568 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.477549    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a\": container with ID starting with de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a not found: ID does not exist" containerID="de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a"
Oct 30 18:38:05.477682 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.477573    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a"} err="failed to get container status \"de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a\": rpc error: code = NotFound desc = could not find container \"de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a\": container with ID starting with de9dc398050cd38166bf7ea5bd4b036e6eb1fa46c3e5477879e22e05fb851f0a not found: ID does not exist"
Oct 30 18:38:05.477682 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.477590    6064 scope.go:122] "RemoveContainer" containerID="984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941"
Oct 30 18:38:05.477875 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.477857    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941\": container with ID starting with 984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941 not found: ID does not exist" containerID="984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941"
Oct 30 18:38:05.477915 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.477880    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941"} err="failed to get container status \"984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941\": rpc error: code = NotFound desc = could not find container \"984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941\": container with ID starting with 984c632cda3538f3f8f95f61ffd62a43ef6e544c72e78f221514898ca19a8941 not found: ID does not exist"
Oct 30 18:38:05.477915 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.477894    6064 scope.go:122] "RemoveContainer" containerID="842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c"
Oct 30 18:38:05.478171 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.478151    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c\": container with ID starting with 842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c not found: ID does not exist" containerID="842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c"
Oct 30 18:38:05.478219 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.478175    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c"} err="failed to get container status \"842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c\": rpc error: code = NotFound desc = could not find container \"842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c\": container with ID starting with 842e93586ac6647df3bafd1f8c685168a600934885ab6ee702e97a0ad9b0ac2c not found: ID does not exist"
Oct 30 18:38:05.478219 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.478189    6064 scope.go:122] "RemoveContainer" containerID="9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0"
Oct 30 18:38:05.478424 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:05.478409    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0\": container with ID starting with 9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0 not found: ID does not exist" containerID="9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0"
Oct 30 18:38:05.478461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.478429    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0"} err="failed to get container status \"9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0\": rpc error: code = NotFound desc = could not find container \"9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0\": container with ID starting with 9a798d8f3d41c9ce87ad2652fc71e23091db80dcc9f8c773c3f40ede78646ff0 not found: ID does not exist"
Oct 30 18:38:05.488929 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.488909    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:05.489341 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489324    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="init-config-reloader"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489343    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="init-config-reloader"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489360    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-metric"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489366    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-metric"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489396    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="config-reloader"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489401    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="config-reloader"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489410    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy"
Oct 30 18:38:05.489415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489416    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489422    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-web"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489427    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-web"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489435    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="prom-label-proxy"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489439    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="prom-label-proxy"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489449    6064 cpu_manager.go:414] "containerMap: removing container" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="alertmanager"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489453    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="alertmanager"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489506    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="prom-label-proxy"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489515    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="alertmanager"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489523    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="init-config-reloader"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489529    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-metric"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489535    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="config-reloader"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489541    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy"
Oct 30 18:38:05.489608 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.489546    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" containerName="kube-rbac-proxy-web"
Oct 30 18:38:05.494361 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.494325    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.509806 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.509789    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 18:38:05.510052 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510037    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 18:38:05.510124 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510105    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 18:38:05.510173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510108    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 18:38:05.510227 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510213    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 18:38:05.510279 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510251    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gmwpq\""
Oct 30 18:38:05.510279 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510251    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 18:38:05.510279 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510268    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 18:38:05.510738 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.510702    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 18:38:05.514361 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.514329    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:05.536669 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.536630    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 18:38:05.651419 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651392    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651522 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651430    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f3dfb12-8564-4e04-988d-425c9eb79996-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651522 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651455    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f3dfb12-8564-4e04-988d-425c9eb79996-config-out\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651522 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651509    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651642    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651712 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651705    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f3dfb12-8564-4e04-988d-425c9eb79996-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651791 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651769    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cb62\" (UniqueName: \"kubernetes.io/projected/7f3dfb12-8564-4e04-988d-425c9eb79996-kube-api-access-5cb62\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651841 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651796    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651894 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651872    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f3dfb12-8564-4e04-988d-425c9eb79996-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.651954 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651911    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-web-config\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.652009 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651950    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.652009 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.651977    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f3dfb12-8564-4e04-988d-425c9eb79996-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.652101 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.652006    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752629 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752563    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752629 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752599    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f3dfb12-8564-4e04-988d-425c9eb79996-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752629 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752631    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cb62\" (UniqueName: \"kubernetes.io/projected/7f3dfb12-8564-4e04-988d-425c9eb79996-kube-api-access-5cb62\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752686    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752713    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f3dfb12-8564-4e04-988d-425c9eb79996-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752734    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-web-config\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752760    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752784    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f3dfb12-8564-4e04-988d-425c9eb79996-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752809    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.752862 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752849    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.753200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752885    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f3dfb12-8564-4e04-988d-425c9eb79996-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.753200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752926    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f3dfb12-8564-4e04-988d-425c9eb79996-config-out\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.753200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.752954    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.753200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.753038    6064 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 18:38:05.753495 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.753462    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f3dfb12-8564-4e04-988d-425c9eb79996-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.754268 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.754119    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f3dfb12-8564-4e04-988d-425c9eb79996-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.754268 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.754127    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7f3dfb12-8564-4e04-988d-425c9eb79996-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.755936 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.755891    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f3dfb12-8564-4e04-988d-425c9eb79996-config-out\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.756428 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.756385    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.756428 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.756393    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.756616 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.756591    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.756735 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.756710    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-web-config\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.756823 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.756788    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.757079 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.757057    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-config-volume\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.757149 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.757133    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f3dfb12-8564-4e04-988d-425c9eb79996-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.757784 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.757767    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7f3dfb12-8564-4e04-988d-425c9eb79996-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.769705 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.769688    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cb62\" (UniqueName: \"kubernetes.io/projected/7f3dfb12-8564-4e04-988d-425c9eb79996-kube-api-access-5cb62\") pod \"alertmanager-main-0\" (UID: \"7f3dfb12-8564-4e04-988d-425c9eb79996\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:05.819268 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:05.819249    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 18:38:06.124901 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:06.124875    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 18:38:06.127923 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:38:06.127891    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3dfb12_8564_4e04_988d_425c9eb79996.slice/crio-79b691f0483d1a0b777eb99f231ac414670e573ecda8885c347ac4d49bfcd7cc WatchSource:0}: Error finding container 79b691f0483d1a0b777eb99f231ac414670e573ecda8885c347ac4d49bfcd7cc: Status 404 returned error can't find the container with id 79b691f0483d1a0b777eb99f231ac414670e573ecda8885c347ac4d49bfcd7cc
Oct 30 18:38:06.409026 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:06.408958    6064 generic.go:356] "Generic (PLEG): container finished" podID="7f3dfb12-8564-4e04-988d-425c9eb79996" containerID="6665c5e94ec56719fe4bdb154f02171ff97784ed96010b141d7883f23f6f9593" exitCode=0
Oct 30 18:38:06.409333 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:06.409031    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerDied","Data":"6665c5e94ec56719fe4bdb154f02171ff97784ed96010b141d7883f23f6f9593"}
Oct 30 18:38:06.409333 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:06.409089    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"79b691f0483d1a0b777eb99f231ac414670e573ecda8885c347ac4d49bfcd7cc"}
Oct 30 18:38:07.236828 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.236787    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7cdff48494-95kkl" podUID="a02247e5-ec62-447f-906d-8a475609d158" containerName="console" containerID="cri-o://ed0d6a7add1ebc22eea9d7a3c91640a9aaabcb8c849129a88683e5a6098d03bf" gracePeriod=15
Oct 30 18:38:07.238234 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.238211    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18ac92f9-c17a-4920-9919-1ac0263481e5" path="/var/lib/kubelet/pods/18ac92f9-c17a-4920-9919-1ac0263481e5/volumes"
Oct 30 18:38:07.424618 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.424585    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"cc197d6ee1c83fbd244aab1a7c2f3605c90aadbb88cca142abd36fd3353ddad5"}
Oct 30 18:38:07.425044 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.424718    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"0870af13d339e928273718ea49ed64a0760e91c711d23df2a6d0640cae0e3262"}
Oct 30 18:38:07.425044 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.424769    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"26d5fb104cdd6e533e774879d52186f9c82b0ef27c30a54793e690f2bbbc9714"}
Oct 30 18:38:07.425044 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.424807    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"5a175ee9118801aaeda4502165a467326fdd6a0d1120c38fa54dac6585ec0bed"}
Oct 30 18:38:07.425044 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.424846    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"982a2e4738513917d66c7d9773c3e4f4c49dc56ed89e3157ea20a1f741dff32e"}
Oct 30 18:38:07.425044 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.424883    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7f3dfb12-8564-4e04-988d-425c9eb79996","Type":"ContainerStarted","Data":"dc3c59bf4c28bff0fe68de5a6a154003dc6108a4628142f873838e67491ce6e7"}
Oct 30 18:38:07.426623 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.426599    6064 generic.go:356] "Generic (PLEG): container finished" podID="a02247e5-ec62-447f-906d-8a475609d158" containerID="ed0d6a7add1ebc22eea9d7a3c91640a9aaabcb8c849129a88683e5a6098d03bf" exitCode=0
Oct 30 18:38:07.426750 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.426687    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdff48494-95kkl" event={"ID":"a02247e5-ec62-447f-906d-8a475609d158","Type":"ContainerDied","Data":"ed0d6a7add1ebc22eea9d7a3c91640a9aaabcb8c849129a88683e5a6098d03bf"}
Oct 30 18:38:07.468615 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.468562    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4563521 podStartE2EDuration="2.468549435s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.197335ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:07.46738443 +0000 UTC m=+26.345657251" watchObservedRunningTime="2026-10-30 18:38:07.468549435 +0000 UTC m=+26.346822252"
Oct 30 18:38:07.483138 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.483116    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:38:07.570070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.569883    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.569934    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.569986    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570016    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570049    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570427 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570122    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570427 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570153    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570427 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570221    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") pod \"a02247e5-ec62-447f-906d-8a475609d158\" (UID: \"a02247e5-ec62-447f-906d-8a475609d158\") "
Oct 30 18:38:07.570427 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570336    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:07.570639 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570508    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:07.570639 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570536    6064 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a02247e5-ec62-447f-906d-8a475609d158-tmp\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.570799 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570768    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:07.571007 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.570952    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:07.571263 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.571060    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:07.572636 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.572613    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:07.572787 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.572765    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "kube-api-access-6wfg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:07.572876 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.572859    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config" pod "a02247e5-ec62-447f-906d-8a475609d158" (UID: "a02247e5-ec62-447f-906d-8a475609d158"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:07.671789 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671760    6064 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-console-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.671789 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671788    6064 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-trusted-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.671939 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671798    6064 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.671939 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671807    6064 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-oauth-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.671939 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671815    6064 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a02247e5-ec62-447f-906d-8a475609d158-console-oauth-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.671939 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671824    6064 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a02247e5-ec62-447f-906d-8a475609d158-service-ca\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.671939 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.671833    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wfg7\" (UniqueName: \"kubernetes.io/projected/a02247e5-ec62-447f-906d-8a475609d158-kube-api-access-6wfg7\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:07.941053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941015    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:07.941599 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941420    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="prometheus" containerID="cri-o://650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0" gracePeriod=600
Oct 30 18:38:07.941599 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941447    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-web" containerID="cri-o://6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb" gracePeriod=600
Oct 30 18:38:07.941599 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941440    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="thanos-sidecar" containerID="cri-o://3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828" gracePeriod=600
Oct 30 18:38:07.941599 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941478    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="config-reloader" containerID="cri-o://9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1" gracePeriod=600
Oct 30 18:38:07.941599 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941508    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85" gracePeriod=600
Oct 30 18:38:07.941599 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:07.941434    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy" containerID="cri-o://7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf" gracePeriod=600
Oct 30 18:38:08.063302 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.063277    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7958"
Oct 30 18:38:08.331987 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.331874    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-556db5d9b4-9fjwk" podUID="986df46a-1438-4ec9-a665-9093589b136f" containerName="console" containerID="cri-o://8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb" gracePeriod=15
Oct 30 18:38:08.431945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.431919    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdff48494-95kkl"
Oct 30 18:38:08.432334 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.431945    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdff48494-95kkl" event={"ID":"a02247e5-ec62-447f-906d-8a475609d158","Type":"ContainerDied","Data":"a844fa37bdd13736521189ec9a95e41f9883644215fb86e1f1dcc552e15b7628"}
Oct 30 18:38:08.432334 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.432007    6064 scope.go:122] "RemoveContainer" containerID="ed0d6a7add1ebc22eea9d7a3c91640a9aaabcb8c849129a88683e5a6098d03bf"
Oct 30 18:38:08.435828 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435805    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85" exitCode=0
Oct 30 18:38:08.435828 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435829    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf" exitCode=0
Oct 30 18:38:08.435972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435840    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828" exitCode=0
Oct 30 18:38:08.435972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435849    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1" exitCode=0
Oct 30 18:38:08.435972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435857    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0" exitCode=0
Oct 30 18:38:08.435972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435885    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85"}
Oct 30 18:38:08.435972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.435964    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf"}
Oct 30 18:38:08.436196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.436014    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828"}
Oct 30 18:38:08.436196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.436055    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1"}
Oct 30 18:38:08.436196 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.436095    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0"}
Oct 30 18:38:08.463140 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.463118    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdff48494-95kkl"]
Oct 30 18:38:08.467750 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.467586    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cdff48494-95kkl"]
Oct 30 18:38:08.588130 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.588110    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:38:08.681522 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681497    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.681680 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681538    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.681680 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681591    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.681804 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681689    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.681804 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681720    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.681804 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681760    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.681953 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.681801    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") pod \"986df46a-1438-4ec9-a665-9093589b136f\" (UID: \"986df46a-1438-4ec9-a665-9093589b136f\") "
Oct 30 18:38:08.682046 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.682014    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:08.682106 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.682077    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:08.682180 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.682109    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:08.682180 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.682116    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:08.684110 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.684084    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:08.684212 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.684110    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "kube-api-access-gk56v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:08.684212 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.684130    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert" pod "986df46a-1438-4ec9-a665-9093589b136f" (UID: "986df46a-1438-4ec9-a665-9093589b136f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:08.782992 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.782970    6064 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-console-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:08.782992 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.782993    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk56v\" (UniqueName: \"kubernetes.io/projected/986df46a-1438-4ec9-a665-9093589b136f-kube-api-access-gk56v\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:08.783131 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.783004    6064 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986df46a-1438-4ec9-a665-9093589b136f-tmp\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:08.783131 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.783014    6064 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:08.783131 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.783022    6064 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-oauth-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:08.783131 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.783030    6064 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/986df46a-1438-4ec9-a665-9093589b136f-console-oauth-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:08.783131 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:08.783038    6064 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/986df46a-1438-4ec9-a665-9093589b136f-service-ca\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.200038 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.200013    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.237498 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.237460    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a02247e5-ec62-447f-906d-8a475609d158" path="/var/lib/kubelet/pods/a02247e5-ec62-447f-906d-8a475609d158/volumes"
Oct 30 18:38:09.287567 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287505    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287567 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287543    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287754 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287586    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287754 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287634    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287754 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287692    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287754 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287725    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287974 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287760    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287974 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287799    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287974 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287906    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.287974 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287952    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.287986    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288016    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288033    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288047    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288081    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288117    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288173 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288154    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288491 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288216    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288491 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288251    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288491 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288281    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288491 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288329    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\" (UID: \"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1\") "
Oct 30 18:38:09.288701 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288578    6064 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.289000 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288041    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.289000 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.288154    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.289561 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.289364    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.290094 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.289865    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:09.290094 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.289953    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.290094 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.290054    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.291070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.291029    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:09.292583 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.292555    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.292583 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.292555    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:09.293092 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293056    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.293222 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293204    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.293323 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293305    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.293430 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293407    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.293521 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293504    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.293581 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293561    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:09.293631 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293573    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "kube-api-access-w6jl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:09.293631 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293583    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.293738 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.293671    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.302505 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.302486    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config" pod "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" (UID: "d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:09.389422 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389382    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6jl5\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-kube-api-access-w6jl5\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389422 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389408    6064 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389422 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389420    6064 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389422 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389430    6064 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-config-out\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389439    6064 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-db\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389448    6064 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389456    6064 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389465    6064 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389475    6064 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389484    6064 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389495    6064 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-tls-assets\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389503    6064 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389513    6064 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-web-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389522    6064 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-configmap-metrics-client-ca\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389530    6064 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-grpc-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389538    6064 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-metrics-client-certs\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389546    6064 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-kube-rbac-proxy\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389555    6064 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.389794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.389563    6064 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:09.448728 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.448697    6064 generic.go:356] "Generic (PLEG): container finished" podID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerID="6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb" exitCode=0
Oct 30 18:38:09.449091 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.448749    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb"}
Oct 30 18:38:09.449091 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.448774    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.449091 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.448851    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1","Type":"ContainerDied","Data":"d4cde33887bbaa65c1a30ced846aa13867e7182a17a7869ea1e372487e33cdd5"}
Oct 30 18:38:09.449091 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.448900    6064 scope.go:122] "RemoveContainer" containerID="6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85"
Oct 30 18:38:09.450282 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.450251    6064 generic.go:356] "Generic (PLEG): container finished" podID="986df46a-1438-4ec9-a665-9093589b136f" containerID="8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb" exitCode=0
Oct 30 18:38:09.450364 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.450288    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556db5d9b4-9fjwk" event={"ID":"986df46a-1438-4ec9-a665-9093589b136f","Type":"ContainerDied","Data":"8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb"}
Oct 30 18:38:09.450364 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.450332    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556db5d9b4-9fjwk" event={"ID":"986df46a-1438-4ec9-a665-9093589b136f","Type":"ContainerDied","Data":"9c79a8c32cb70f5cd728aaf2cd76d26f703ec7f60de7418f951819657c50664b"}
Oct 30 18:38:09.450509 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.450491    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556db5d9b4-9fjwk"
Oct 30 18:38:09.457007 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.456986    6064 scope.go:122] "RemoveContainer" containerID="7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf"
Oct 30 18:38:09.463848 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.463832    6064 scope.go:122] "RemoveContainer" containerID="6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb"
Oct 30 18:38:09.471149 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.471132    6064 scope.go:122] "RemoveContainer" containerID="3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828"
Oct 30 18:38:09.477794 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.477780    6064 scope.go:122] "RemoveContainer" containerID="9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1"
Oct 30 18:38:09.484160 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.484140    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556db5d9b4-9fjwk"]
Oct 30 18:38:09.484909 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.484896    6064 scope.go:122] "RemoveContainer" containerID="650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0"
Oct 30 18:38:09.491861 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.491845    6064 scope.go:122] "RemoveContainer" containerID="a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf"
Oct 30 18:38:09.498461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.498439    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-556db5d9b4-9fjwk"]
Oct 30 18:38:09.499621 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.499598    6064 scope.go:122] "RemoveContainer" containerID="6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85"
Oct 30 18:38:09.499902 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.499883    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85\": container with ID starting with 6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85 not found: ID does not exist" containerID="6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85"
Oct 30 18:38:09.499948 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.499915    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85"} err="failed to get container status \"6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85\": rpc error: code = NotFound desc = could not find container \"6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85\": container with ID starting with 6874f1044c276188171c40e32ab14a07d9adb2781eb385132cfc9a75c7074f85 not found: ID does not exist"
Oct 30 18:38:09.499948 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.499932    6064 scope.go:122] "RemoveContainer" containerID="7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf"
Oct 30 18:38:09.500179 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.500162    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf\": container with ID starting with 7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf not found: ID does not exist" containerID="7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf"
Oct 30 18:38:09.500218 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500185    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf"} err="failed to get container status \"7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf\": rpc error: code = NotFound desc = could not find container \"7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf\": container with ID starting with 7ba033fcb8b78146df0428305978bc8efb97724c94b6e9890073b8157ca079cf not found: ID does not exist"
Oct 30 18:38:09.500218 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500200    6064 scope.go:122] "RemoveContainer" containerID="6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb"
Oct 30 18:38:09.500408 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.500391    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb\": container with ID starting with 6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb not found: ID does not exist" containerID="6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb"
Oct 30 18:38:09.500443 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500416    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb"} err="failed to get container status \"6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb\": rpc error: code = NotFound desc = could not find container \"6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb\": container with ID starting with 6d006dc21dc07599303a9fb23fcea1674faa3b9dad2ae55311422b721679b6cb not found: ID does not exist"
Oct 30 18:38:09.500443 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500429    6064 scope.go:122] "RemoveContainer" containerID="3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828"
Oct 30 18:38:09.500689 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.500643    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828\": container with ID starting with 3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828 not found: ID does not exist" containerID="3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828"
Oct 30 18:38:09.500741 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500696    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828"} err="failed to get container status \"3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828\": rpc error: code = NotFound desc = could not find container \"3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828\": container with ID starting with 3e075a69e660216a9e26f608456822ba9ede110d3401cf9684d325c291d9f828 not found: ID does not exist"
Oct 30 18:38:09.500741 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500710    6064 scope.go:122] "RemoveContainer" containerID="9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1"
Oct 30 18:38:09.500954 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.500939    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1\": container with ID starting with 9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1 not found: ID does not exist" containerID="9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1"
Oct 30 18:38:09.500990 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500956    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1"} err="failed to get container status \"9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1\": rpc error: code = NotFound desc = could not find container \"9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1\": container with ID starting with 9511536aca44d04b3eb93e070d8dc130e0a4beb9cc23c2a5b53fe62705edc6c1 not found: ID does not exist"
Oct 30 18:38:09.500990 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.500978    6064 scope.go:122] "RemoveContainer" containerID="650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0"
Oct 30 18:38:09.501204 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.501187    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0\": container with ID starting with 650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0 not found: ID does not exist" containerID="650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0"
Oct 30 18:38:09.501270 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.501209    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0"} err="failed to get container status \"650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0\": rpc error: code = NotFound desc = could not find container \"650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0\": container with ID starting with 650657d76d358b57171dd95d9d82acba7cb560043ab94476261f621304bfdfb0 not found: ID does not exist"
Oct 30 18:38:09.501270 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.501222    6064 scope.go:122] "RemoveContainer" containerID="a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf"
Oct 30 18:38:09.501442 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.501428    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf\": container with ID starting with a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf not found: ID does not exist" containerID="a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf"
Oct 30 18:38:09.501476 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.501444    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf"} err="failed to get container status \"a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf\": rpc error: code = NotFound desc = could not find container \"a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf\": container with ID starting with a9cb042053690037c7bccb2be6f435d11ae79d3904cf4afd315f1d85fda533cf not found: ID does not exist"
Oct 30 18:38:09.501476 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.501455    6064 scope.go:122] "RemoveContainer" containerID="8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb"
Oct 30 18:38:09.508327 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.508311    6064 scope.go:122] "RemoveContainer" containerID="8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb"
Oct 30 18:38:09.508563 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:09.508547    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb\": container with ID starting with 8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb not found: ID does not exist" containerID="8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb"
Oct 30 18:38:09.508621 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.508568    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb"} err="failed to get container status \"8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb\": rpc error: code = NotFound desc = could not find container \"8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb\": container with ID starting with 8e4eb9b47ed02883f8f651d2f7c998c26cb2956da886707d1089169ce65134fb not found: ID does not exist"
Oct 30 18:38:09.525043 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.525021    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:09.530157 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.530135    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:09.574417 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574365    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:09.574717 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574703    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="init-config-reloader"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574719    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="init-config-reloader"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574734    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-thanos"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574739    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-thanos"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574748    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-web"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574753    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-web"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574761    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="config-reloader"
Oct 30 18:38:09.574767 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574766    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="config-reloader"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574773    6064 cpu_manager.go:414] "containerMap: removing container" podUID="986df46a-1438-4ec9-a665-9093589b136f" containerName="console"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574787    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="986df46a-1438-4ec9-a665-9093589b136f" containerName="console"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574798    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="prometheus"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574802    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="prometheus"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574809    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574813    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574820    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="thanos-sidecar"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574824    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="thanos-sidecar"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574832    6064 cpu_manager.go:414] "containerMap: removing container" podUID="a02247e5-ec62-447f-906d-8a475609d158" containerName="console"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574836    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a02247e5-ec62-447f-906d-8a475609d158" containerName="console"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574892    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-web"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574900    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="config-reloader"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574906    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="986df46a-1438-4ec9-a665-9093589b136f" containerName="console"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574914    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="prometheus"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574920    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574926    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="thanos-sidecar"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574931    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="a02247e5-ec62-447f-906d-8a475609d158" containerName="console"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574938    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="init-config-reloader"
Oct 30 18:38:09.574972 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.574943    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" containerName="kube-rbac-proxy-thanos"
Oct 30 18:38:09.580289 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.580273    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.616714 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.616697    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kfsqx\""
Oct 30 18:38:09.616797 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.616713    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 18:38:09.616797 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.616754    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0huhn2rtoft9\""
Oct 30 18:38:09.616939 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.616927    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 18:38:09.616977 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.616967    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 18:38:09.617157 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.617147    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 18:38:09.617457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.617444    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 18:38:09.618386 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.618375    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 18:38:09.618723 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.618704    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 18:38:09.624830 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.624808    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 18:38:09.627929 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.627913    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 18:38:09.628497 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.628484    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 18:38:09.628536 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.628509    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 18:38:09.630561 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.630524    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 18:38:09.630630 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.630622    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 18:38:09.634746 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.634726    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 18:38:09.640065 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.640044    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:09.691634 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691608    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-config\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691751 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691636    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691751 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691676    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691751 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691739    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691857 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691777    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691857 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691796    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691857 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691822    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.691857 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691840    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691858    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691915    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691944    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736b99f4-9e5c-4934-9d55-b18c7e42d58b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.691988    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736b99f4-9e5c-4934-9d55-b18c7e42d58b-config-out\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692010    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692032    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692071    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692105    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692120    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-web-config\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692152 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692142    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv2zh\" (UniqueName: \"kubernetes.io/projected/736b99f4-9e5c-4934-9d55-b18c7e42d58b-kube-api-access-dv2zh\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692285 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692237    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.692285 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.692262    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793225 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793204    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793225 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793229    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793377 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793252    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793377 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793268    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793377 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793334    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793486 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793378    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793486 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793405    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736b99f4-9e5c-4934-9d55-b18c7e42d58b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793486 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793454    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736b99f4-9e5c-4934-9d55-b18c7e42d58b-config-out\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793486 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793479    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793507    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793529    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793552    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793578    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-web-config\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793603    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv2zh\" (UniqueName: \"kubernetes.io/projected/736b99f4-9e5c-4934-9d55-b18c7e42d58b-kube-api-access-dv2zh\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793643    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.793703 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793700    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793739    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-config\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793775    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793799    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793823    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794053 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.793976    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794476 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.794188    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.794561 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.794539    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.795181 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.795155    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.796787 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.796758    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.796787 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.796769    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.796961 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.796809    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.796961 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.796938    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.797072 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.797052    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.797220 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.797199    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.797442 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.797414    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.797883 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.797860    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-web-config\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.798294 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.798080    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.798294 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.798251    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736b99f4-9e5c-4934-9d55-b18c7e42d58b-config-out\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.798668 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.798631    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736b99f4-9e5c-4934-9d55-b18c7e42d58b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.799876 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.799850    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-config\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.799956 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.799910    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.800038 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.800023    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736b99f4-9e5c-4934-9d55-b18c7e42d58b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.800070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.800037    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736b99f4-9e5c-4934-9d55-b18c7e42d58b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.818818 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.818797    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv2zh\" (UniqueName: \"kubernetes.io/projected/736b99f4-9e5c-4934-9d55-b18c7e42d58b-kube-api-access-dv2zh\") pod \"prometheus-k8s-0\" (UID: \"736b99f4-9e5c-4934-9d55-b18c7e42d58b\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:09.905285 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:09.905257    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:10.209769 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:10.209689    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 18:38:10.216681 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:38:10.216637    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736b99f4_9e5c_4934_9d55_b18c7e42d58b.slice/crio-93b3820b51a51390750aa55100d8830c436f65d52521b7cd74c65b549e44ee9a WatchSource:0}: Error finding container 93b3820b51a51390750aa55100d8830c436f65d52521b7cd74c65b549e44ee9a: Status 404 returned error can't find the container with id 93b3820b51a51390750aa55100d8830c436f65d52521b7cd74c65b549e44ee9a
Oct 30 18:38:10.463682 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:10.463593    6064 generic.go:356] "Generic (PLEG): container finished" podID="736b99f4-9e5c-4934-9d55-b18c7e42d58b" containerID="23392742167ae1007e25434495f8073a0751b21ba4249af648e884a48915c121" exitCode=0
Oct 30 18:38:10.463682 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:10.463649    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerDied","Data":"23392742167ae1007e25434495f8073a0751b21ba4249af648e884a48915c121"}
Oct 30 18:38:10.464063 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:10.463766    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"93b3820b51a51390750aa55100d8830c436f65d52521b7cd74c65b549e44ee9a"}
Oct 30 18:38:11.239062 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.239029    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="986df46a-1438-4ec9-a665-9093589b136f" path="/var/lib/kubelet/pods/986df46a-1438-4ec9-a665-9093589b136f/volumes"
Oct 30 18:38:11.239448 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.239433    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1" path="/var/lib/kubelet/pods/d2ac2bd3-795e-46f0-b689-7bac9ddc3ed1/volumes"
Oct 30 18:38:11.470391 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.470358    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"f497317305442399071d5ec8e842f3bb8085751c7af71ae168ac42701ec34ecd"}
Oct 30 18:38:11.470873 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.470420    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"4d178bdecb54fd57f469b1c6acdc3793647b193373977a3b462ef8f420b9d97f"}
Oct 30 18:38:11.470873 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.470448    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"1a5ca3be794073f5966839b5f2a666d5cdc52674ad5c84f4407eba49b3bc0adb"}
Oct 30 18:38:11.470873 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.470471    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"6fd1765ef919f0df75fe6ba00f3d3626dbae8d4fd0b82feb11a243ae22afae70"}
Oct 30 18:38:11.470873 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.470494    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"e75039cf75735699887fdfd28834ffacd86b24dcf0afd8eddc635d13f5370c8b"}
Oct 30 18:38:11.470873 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.470517    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736b99f4-9e5c-4934-9d55-b18c7e42d58b","Type":"ContainerStarted","Data":"ccb46c0f1713255d035574e87391c60980a13869f0f54bac4dee44daae107920"}
Oct 30 18:38:11.520170 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:11.520099    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.499562708 podStartE2EDuration="2.520087009s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.524301ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:11.518245729 +0000 UTC m=+30.396518561" watchObservedRunningTime="2026-10-30 18:38:11.520087009 +0000 UTC m=+30.398359819"
Oct 30 18:38:12.408259 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.408225    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f8b94fb8-m77xs"]
Oct 30 18:38:12.443414 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.443391    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f8b94fb8-m77xs"]
Oct 30 18:38:12.443534 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.443478    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.515733 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.515709    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516089 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.515852    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516089 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.516013    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516184 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.516087    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516184 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.516129    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516290 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.516234    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq9w9\" (UniqueName: \"kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516290 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.516279    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.516496 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.516480    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617485 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617465    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617579 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617490    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617579 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617508    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617579 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617524    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617579 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617546    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq9w9\" (UniqueName: \"kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617579 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617562    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617886 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617581    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.617886 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.617643    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.618208 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.618176    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.618306 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.618296    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.618366 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.618311    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.618419 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.618368    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.618511 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.618494    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.620941 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.620918    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.621046 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.621023    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.630784 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.630763    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq9w9\" (UniqueName: \"kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9\") pod \"console-6f8b94fb8-m77xs\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") " pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:12.769478 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:12.769426    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:13.087709 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:13.087671    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f8b94fb8-m77xs"]
Oct 30 18:38:13.092837 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:38:13.092800    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81808834_d51b_4930_84f4_1412a0bb6757.slice/crio-2318daab690bc0ddedc886c30f9b380637c8edefc7b76fbc06c610b475355a35 WatchSource:0}: Error finding container 2318daab690bc0ddedc886c30f9b380637c8edefc7b76fbc06c610b475355a35: Status 404 returned error can't find the container with id 2318daab690bc0ddedc886c30f9b380637c8edefc7b76fbc06c610b475355a35
Oct 30 18:38:13.478507 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:13.478434    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8b94fb8-m77xs" event={"ID":"81808834-d51b-4930-84f4-1412a0bb6757","Type":"ContainerStarted","Data":"590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546"}
Oct 30 18:38:13.478507 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:13.478478    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8b94fb8-m77xs" event={"ID":"81808834-d51b-4930-84f4-1412a0bb6757","Type":"ContainerStarted","Data":"2318daab690bc0ddedc886c30f9b380637c8edefc7b76fbc06c610b475355a35"}
Oct 30 18:38:13.505040 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:13.504986    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6f8b94fb8-m77xs" podStartSLOduration=1.504970575 podStartE2EDuration="1.504970575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:13.503622315 +0000 UTC m=+32.381895135" watchObservedRunningTime="2026-10-30 18:38:13.504970575 +0000 UTC m=+32.383243394"
Oct 30 18:38:13.980094 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:13.980065    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gw4w2"
Oct 30 18:38:14.905980 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:14.905944    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:22.770376 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:22.770343    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:22.770815 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:22.770410    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:22.774855 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:22.774827    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:23.058856 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:23.058771    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:38:23.519681 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:23.519632    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:38:23.637893 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:23.637859    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7cd7686f-fzssr"]
Oct 30 18:38:45.661463 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:45.661418    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:45.677845 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:45.677822    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:46.632855 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:46.632826    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 18:38:48.658312 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:48.658257    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6b7cd7686f-fzssr" podUID="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" containerName="console" containerID="cri-o://ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16" gracePeriod=15
Oct 30 18:38:48.929828 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:48.929802    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:38:49.019155 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019125    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019312 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019179    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019312 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019226    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019312 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019247    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019312 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019288    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019478 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019344    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019478 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019378    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019478 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019426    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") pod \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\" (UID: \"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c\") "
Oct 30 18:38:49.019900 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019857    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:38:49.019900 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019884    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:49.020067 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.019992    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:49.020067 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.020004    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:49.020176 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.020155    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:38:49.021604 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.021581    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "kube-api-access-fztlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:38:49.021726 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.021706    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:49.021792 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.021767    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config" pod "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" (UID: "ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:38:49.052824 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.052783    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-66d666d5dc-g8p29"]
Oct 30 18:38:49.053178 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.053162    6064 cpu_manager.go:414] "containerMap: removing container" podUID="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" containerName="console"
Oct 30 18:38:49.053228 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.053180    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" containerName="console"
Oct 30 18:38:49.053276 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.053267    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" containerName="console"
Oct 30 18:38:49.057283 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.057268    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.071301 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.071275    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d666d5dc-g8p29"]
Oct 30 18:38:49.120600 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120566    6064 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120600 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120598    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fztlg\" (UniqueName: \"kubernetes.io/projected/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-kube-api-access-fztlg\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120600 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120610    6064 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-oauth-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120786 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120620    6064 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-console-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120786 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120634    6064 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-oauth-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120786 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120646    6064 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-tmp\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120786 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120669    6064 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-trusted-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.120786 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.120680    6064 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c-service-ca\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:38:49.221049 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.220993    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-serving-cert\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221049 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221021    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-trusted-ca-bundle\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221049 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221047    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-oauth-config\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221234 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221123    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhqz\" (UniqueName: \"kubernetes.io/projected/92d8acc0-9d93-49ae-ab67-10e3710e35da-kube-api-access-7fhqz\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221234 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221221    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-service-ca\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221342 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221298    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92d8acc0-9d93-49ae-ab67-10e3710e35da-tmp\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221396 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221356    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-oauth-serving-cert\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.221453 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.221423    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-config\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322377 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322351    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92d8acc0-9d93-49ae-ab67-10e3710e35da-tmp\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322389    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-oauth-serving-cert\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322423    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-config\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322447    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-serving-cert\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322636 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322462    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-trusted-ca-bundle\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322636 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322488    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-oauth-config\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322636 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322523    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhqz\" (UniqueName: \"kubernetes.io/projected/92d8acc0-9d93-49ae-ab67-10e3710e35da-kube-api-access-7fhqz\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322636 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322550    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-service-ca\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.322877 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.322819    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92d8acc0-9d93-49ae-ab67-10e3710e35da-tmp\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.323240 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.323214    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-oauth-serving-cert\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.323490 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.323328    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-config\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.323490 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.323397    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-trusted-ca-bundle\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.323796 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.323775    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d8acc0-9d93-49ae-ab67-10e3710e35da-service-ca\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.324978 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.324950    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-serving-cert\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.325151 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.325129    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d8acc0-9d93-49ae-ab67-10e3710e35da-console-oauth-config\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.334454 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.334434    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhqz\" (UniqueName: \"kubernetes.io/projected/92d8acc0-9d93-49ae-ab67-10e3710e35da-kube-api-access-7fhqz\") pod \"console-66d666d5dc-g8p29\" (UID: \"92d8acc0-9d93-49ae-ab67-10e3710e35da\") " pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.368298 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.368274    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:49.630346 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.630310    6064 generic.go:356] "Generic (PLEG): container finished" podID="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" containerID="ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16" exitCode=0
Oct 30 18:38:49.630519 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.630351    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7cd7686f-fzssr" event={"ID":"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c","Type":"ContainerDied","Data":"ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16"}
Oct 30 18:38:49.630519 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.630368    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7cd7686f-fzssr"
Oct 30 18:38:49.630519 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.630430    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7cd7686f-fzssr" event={"ID":"ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c","Type":"ContainerDied","Data":"e3a218b4546a996c89a2b2af18a48fc11da25fcee3d9d3251a3f79f4c7b5e1c4"}
Oct 30 18:38:49.630519 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.630455    6064 scope.go:122] "RemoveContainer" containerID="ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16"
Oct 30 18:38:49.638795 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.638770    6064 scope.go:122] "RemoveContainer" containerID="ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16"
Oct 30 18:38:49.639062 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:49.639044    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16\": container with ID starting with ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16 not found: ID does not exist" containerID="ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16"
Oct 30 18:38:49.639154 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.639072    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16"} err="failed to get container status \"ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16\": rpc error: code = NotFound desc = could not find container \"ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16\": container with ID starting with ae7d2b7c0577f063de29487eebc7f7e382e8c96c54a553de1590c4c64c20df16 not found: ID does not exist"
Oct 30 18:38:49.652046 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.652021    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d666d5dc-g8p29"]
Oct 30 18:38:49.654469 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.654430    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7cd7686f-fzssr"]
Oct 30 18:38:49.655987 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:38:49.655961    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d8acc0_9d93_49ae_ab67_10e3710e35da.slice/crio-a06e132bbde7d5a760b62d980d804eee9d7d93d34134ee8afa0305b19fe45d4c WatchSource:0}: Error finding container a06e132bbde7d5a760b62d980d804eee9d7d93d34134ee8afa0305b19fe45d4c: Status 404 returned error can't find the container with id a06e132bbde7d5a760b62d980d804eee9d7d93d34134ee8afa0305b19fe45d4c
Oct 30 18:38:49.662065 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:49.662042    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7cd7686f-fzssr"]
Oct 30 18:38:50.635412 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:50.635372    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d666d5dc-g8p29" event={"ID":"92d8acc0-9d93-49ae-ab67-10e3710e35da","Type":"ContainerStarted","Data":"bf75e11892dde5dd6553c7517d7ceb1d0c7a59679b912a7c42cd103989ced24b"}
Oct 30 18:38:50.635605 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:50.635428    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d666d5dc-g8p29" event={"ID":"92d8acc0-9d93-49ae-ab67-10e3710e35da","Type":"ContainerStarted","Data":"a06e132bbde7d5a760b62d980d804eee9d7d93d34134ee8afa0305b19fe45d4c"}
Oct 30 18:38:50.655691 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:50.655630    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-66d666d5dc-g8p29" podStartSLOduration=1.655618107 podStartE2EDuration="1.655618107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:38:50.655541428 +0000 UTC m=+69.533814248" watchObservedRunningTime="2026-10-30 18:38:50.655618107 +0000 UTC m=+69.533890923"
Oct 30 18:38:51.238328 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:51.238288    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c" path="/var/lib/kubelet/pods/ae624ce9-fe64-4cb8-a053-4ccf2dabbd9c/volumes"
Oct 30 18:38:53.059375 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:38:53.059337    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:38:59.368626 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:59.368589    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:59.369070 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:59.368681    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:59.373264 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:59.373243    6064 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:59.683011 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:59.682947    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66d666d5dc-g8p29"
Oct 30 18:38:59.735527 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:38:59.735493    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f8b94fb8-m77xs"]
Oct 30 18:39:23.060484 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:39:23.060407    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:39:24.755998 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:24.755933    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6f8b94fb8-m77xs" podUID="81808834-d51b-4930-84f4-1412a0bb6757" containerName="console" containerID="cri-o://590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546" gracePeriod=15
Oct 30 18:39:25.027637 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.027613    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:39:25.090532 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090504    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp\" (UniqueName: \"kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090695 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090541    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090695 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090565    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090791 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090744    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090840 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090804    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:39:25.090840 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090824    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090911 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090865    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090911 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090884    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9\" (UniqueName: \"kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.090985 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090930    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:39:25.091043 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.090991    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config\") pod \"81808834-d51b-4930-84f4-1412a0bb6757\" (UID: \"81808834-d51b-4930-84f4-1412a0bb6757\") "
Oct 30 18:39:25.091232 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.091196    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:39:25.091341 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.091204    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:39:25.091424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.091359    6064 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81808834-d51b-4930-84f4-1412a0bb6757-tmp\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.091424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.091373    6064 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-trusted-ca-bundle\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.091424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.091387    6064 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-oauth-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.091424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.091394    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:39:25.093135 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.093112    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "kube-api-access-sq9w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:39:25.093296 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.093281    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:39:25.093424 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.093404    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert" pod "81808834-d51b-4930-84f4-1412a0bb6757" (UID: "81808834-d51b-4930-84f4-1412a0bb6757"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:39:25.191722 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.191700    6064 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-serving-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.191722 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.191721    6064 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-service-ca\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.191844 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.191731    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq9w9\" (UniqueName: \"kubernetes.io/projected/81808834-d51b-4930-84f4-1412a0bb6757-kube-api-access-sq9w9\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.191844 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.191741    6064 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81808834-d51b-4930-84f4-1412a0bb6757-console-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.191844 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.191749    6064 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81808834-d51b-4930-84f4-1412a0bb6757-console-oauth-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:39:25.775812 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.775780    6064 generic.go:356] "Generic (PLEG): container finished" podID="81808834-d51b-4930-84f4-1412a0bb6757" containerID="590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546" exitCode=0
Oct 30 18:39:25.776189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.775819    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8b94fb8-m77xs" event={"ID":"81808834-d51b-4930-84f4-1412a0bb6757","Type":"ContainerDied","Data":"590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546"}
Oct 30 18:39:25.776189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.775832    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f8b94fb8-m77xs"
Oct 30 18:39:25.776189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.775868    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f8b94fb8-m77xs" event={"ID":"81808834-d51b-4930-84f4-1412a0bb6757","Type":"ContainerDied","Data":"2318daab690bc0ddedc886c30f9b380637c8edefc7b76fbc06c610b475355a35"}
Oct 30 18:39:25.776189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.775894    6064 scope.go:122] "RemoveContainer" containerID="590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546"
Oct 30 18:39:25.783981 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.783965    6064 scope.go:122] "RemoveContainer" containerID="590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546"
Oct 30 18:39:25.784231 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:39:25.784212    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546\": container with ID starting with 590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546 not found: ID does not exist" containerID="590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546"
Oct 30 18:39:25.784275 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.784239    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546"} err="failed to get container status \"590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546\": rpc error: code = NotFound desc = could not find container \"590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546\": container with ID starting with 590d9e65c4ae6fb03073b88ba37b981d23186c2350314cbe45cdd0f858e52546 not found: ID does not exist"
Oct 30 18:39:25.794166 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.794145    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f8b94fb8-m77xs"]
Oct 30 18:39:25.803340 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:25.803319    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f8b94fb8-m77xs"]
Oct 30 18:39:27.239075 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:39:27.239025    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81808834-d51b-4930-84f4-1412a0bb6757" path="/var/lib/kubelet/pods/81808834-d51b-4930-84f4-1412a0bb6757/volumes"
Oct 30 18:39:53.059800 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:39:53.059762    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:40:23.059812 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:40:23.059773    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:40:53.060673 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:40:53.060576    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:41:23.059158 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:41:23.059123    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:41:53.059757 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:41:53.059718    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:42:23.060117 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:42:23.060034    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:42:41.267582 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:42:41.267552    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:42:41.268691 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:42:41.268665    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:42:53.059706 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:42:53.059666    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:43:23.060178 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:43:23.060140    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:43:53.059472 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:43:53.059385    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:44:23.059672 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:44:23.059615    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:44:53.059395 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:44:53.059350    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:45:23.060355 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:45:23.060274    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:45:40.091023 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.090983    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/s3-init-s6t62"]
Oct 30 18:45:40.091419 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.091325    6064 cpu_manager.go:414] "containerMap: removing container" podUID="81808834-d51b-4930-84f4-1412a0bb6757" containerName="console"
Oct 30 18:45:40.091419 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.091338    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81808834-d51b-4930-84f4-1412a0bb6757" containerName="console"
Oct 30 18:45:40.091514 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.091422    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="81808834-d51b-4930-84f4-1412a0bb6757" containerName="console"
Oct 30 18:45:40.094559 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.094542    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.098615 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.098591    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Oct 30 18:45:40.098615 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.098595    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Oct 30 18:45:40.098817 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.098619    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x652p\""
Oct 30 18:45:40.098817 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.098671    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 18:45:40.098817 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.098678    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 18:45:40.105177 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.105157    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-s6t62"]
Oct 30 18:45:40.156589 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.156565    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn5bk\" (UniqueName: \"kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk\") pod \"s3-init-s6t62\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") " pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.156725 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.156590    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache\") pod \"s3-init-s6t62\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") " pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.257841 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.257806    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn5bk\" (UniqueName: \"kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk\") pod \"s3-init-s6t62\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") " pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.257943 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.257844    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache\") pod \"s3-init-s6t62\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") " pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.258231 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.258215    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache\") pod \"s3-init-s6t62\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") " pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.269757 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.269733    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn5bk\" (UniqueName: \"kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk\") pod \"s3-init-s6t62\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") " pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.423116 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.423036    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-s6t62"
Oct 30 18:45:40.702363 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.702282    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-s6t62"]
Oct 30 18:45:40.706753 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:45:40.706711    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8093b71f_ec0d_4e3e_9e42_c28ce0cd3a49.slice/crio-e7c5c66737caab947afc2dd9fb89f36817161d909847b614b87f1b7b09b37967 WatchSource:0}: Error finding container e7c5c66737caab947afc2dd9fb89f36817161d909847b614b87f1b7b09b37967: Status 404 returned error can't find the container with id e7c5c66737caab947afc2dd9fb89f36817161d909847b614b87f1b7b09b37967
Oct 30 18:45:40.709315 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:40.709293    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 18:45:41.147607 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:41.147568    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-s6t62" event={"ID":"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49","Type":"ContainerStarted","Data":"e7c5c66737caab947afc2dd9fb89f36817161d909847b614b87f1b7b09b37967"}
Oct 30 18:45:49.979308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:49.979288    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Oct 30 18:45:50.184377 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:50.184343    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-s6t62" event={"ID":"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49","Type":"ContainerStarted","Data":"ccae81235259705b85a61174a839e040172cbc6599a97401f5f32ceecf5a45c8"}
Oct 30 18:45:52.194401 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:52.194361    6064 generic.go:356] "Generic (PLEG): container finished" podID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerID="ccae81235259705b85a61174a839e040172cbc6599a97401f5f32ceecf5a45c8" exitCode=0
Oct 30 18:45:52.194812 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:52.194438    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-s6t62" event={"ID":"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49","Type":"ContainerDied","Data":"ccae81235259705b85a61174a839e040172cbc6599a97401f5f32ceecf5a45c8"}
Oct 30 18:45:53.066529 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:45:53.066482    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:45:56.560215 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:56.560194    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Oct 30 18:45:57.216932 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:57.216889    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-s6t62" event={"ID":"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49","Type":"ContainerStarted","Data":"455eda67217652b8b0773b7ebac6016d51ec4e76ce8dcc09dd84731d09e68baa"}
Oct 30 18:45:57.236683 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:45:57.236611    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/s3-init-s6t62" podStartSLOduration=2.150921796 podStartE2EDuration="17.236596074s" totalImagesPullingTime="13.620546315s" totalInitContainerRuntime="1.465127963s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:45:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:45:57.236182176 +0000 UTC m=+496.114454996" watchObservedRunningTime="2026-10-30 18:45:57.236596074 +0000 UTC m=+496.114868892"
Oct 30 18:46:23.059613 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:46:23.059572    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:46:53.059058 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:46:53.059016    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:47:02.454425 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:02.454386    6064 generic.go:356] "Generic (PLEG): container finished" podID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerID="455eda67217652b8b0773b7ebac6016d51ec4e76ce8dcc09dd84731d09e68baa" exitCode=0
Oct 30 18:47:02.454864 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:02.454463    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-s6t62" event={"ID":"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49","Type":"ContainerDied","Data":"455eda67217652b8b0773b7ebac6016d51ec4e76ce8dcc09dd84731d09e68baa"}
Oct 30 18:47:03.583354 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.583331    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-s6t62"
Oct 30 18:47:03.720894 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.720829    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache\") pod \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") "
Oct 30 18:47:03.720894 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.720877    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk\" (UniqueName: \"kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk\") pod \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\" (UID: \"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49\") "
Oct 30 18:47:03.723203 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.723177    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk" pod "8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" (UID: "8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49"). InnerVolumeSpecName "kube-api-access-cn5bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:47:03.739549 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.739519    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache" pod "8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" (UID: "8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:47:03.821847 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.821823    6064 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-model-cache\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:47:03.821847 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:03.821845    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn5bk\" (UniqueName: \"kubernetes.io/projected/8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49-kube-api-access-cn5bk\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:47:04.465005 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:04.464974    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-s6t62"
Oct 30 18:47:04.465165 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:04.465003    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-s6t62" event={"ID":"8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49","Type":"ContainerDied","Data":"e7c5c66737caab947afc2dd9fb89f36817161d909847b614b87f1b7b09b37967"}
Oct 30 18:47:04.465165 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:04.465036    6064 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7c5c66737caab947afc2dd9fb89f36817161d909847b614b87f1b7b09b37967"
Oct 30 18:47:23.061541 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:47:23.061498    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:47:39.761401 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.761369    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-h28j5"]
Oct 30 18:47:39.762049 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.762026    6064 cpu_manager.go:414] "containerMap: removing container" podUID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerName="s3-init"
Oct 30 18:47:39.762132 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.762052    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerName="s3-init"
Oct 30 18:47:39.762132 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.762078    6064 cpu_manager.go:414] "containerMap: removing container" podUID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerName="download-hf-model"
Oct 30 18:47:39.762132 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.762086    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerName="download-hf-model"
Oct 30 18:47:39.762292 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.762191    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49" containerName="s3-init"
Oct 30 18:47:39.765371 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.765350    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:39.769499 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.769480    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Oct 30 18:47:39.769499 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.769490    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Oct 30 18:47:39.769630 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.769616    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 18:47:39.769688 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.769679    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 18:47:39.769751 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.769738    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x652p\""
Oct 30 18:47:39.775588 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.775565    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-h28j5"]
Oct 30 18:47:39.895923 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.895899    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache\") pod \"s3-tls-init-custom-h28j5\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") " pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:39.896017 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.895926    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbmmw\" (UniqueName: \"kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw\") pod \"s3-tls-init-custom-h28j5\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") " pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:39.996806 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.996778    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache\") pod \"s3-tls-init-custom-h28j5\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") " pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:39.996916 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.996809    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbmmw\" (UniqueName: \"kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw\") pod \"s3-tls-init-custom-h28j5\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") " pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:39.997138 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:39.997121    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache\") pod \"s3-tls-init-custom-h28j5\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") " pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:40.009222 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:40.009203    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbmmw\" (UniqueName: \"kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw\") pod \"s3-tls-init-custom-h28j5\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") " pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:40.091161 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:40.091143    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:40.365691 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:40.365586    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-h28j5"]
Oct 30 18:47:40.369306 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:47:40.369270    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod044d187c_e0b6_4155_a23e_532b962c0b92.slice/crio-7d640defbf66dd2aee43db134e018a1cc7a1cf92dd155b9d0864ff3d5624c002 WatchSource:0}: Error finding container 7d640defbf66dd2aee43db134e018a1cc7a1cf92dd155b9d0864ff3d5624c002: Status 404 returned error can't find the container with id 7d640defbf66dd2aee43db134e018a1cc7a1cf92dd155b9d0864ff3d5624c002
Oct 30 18:47:40.603425 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:40.603381    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-h28j5" event={"ID":"044d187c-e0b6-4155-a23e-532b962c0b92","Type":"ContainerStarted","Data":"cd4ced82b7fa11e222a8dbe09b9f4a383c10c99e7617e315264892f1f068d860"}
Oct 30 18:47:40.603580 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:40.603437    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-h28j5" event={"ID":"044d187c-e0b6-4155-a23e-532b962c0b92","Type":"ContainerStarted","Data":"7d640defbf66dd2aee43db134e018a1cc7a1cf92dd155b9d0864ff3d5624c002"}
Oct 30 18:47:41.303293 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:41.303259    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:47:41.305573 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:41.305549    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:47:42.614648 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:42.614608    6064 generic.go:356] "Generic (PLEG): container finished" podID="044d187c-e0b6-4155-a23e-532b962c0b92" containerID="cd4ced82b7fa11e222a8dbe09b9f4a383c10c99e7617e315264892f1f068d860" exitCode=0
Oct 30 18:47:42.615029 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:42.614671    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-h28j5" event={"ID":"044d187c-e0b6-4155-a23e-532b962c0b92","Type":"ContainerDied","Data":"cd4ced82b7fa11e222a8dbe09b9f4a383c10c99e7617e315264892f1f068d860"}
Oct 30 18:47:42.624101 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:42.624080    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Oct 30 18:47:43.619976 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:43.619937    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-h28j5" event={"ID":"044d187c-e0b6-4155-a23e-532b962c0b92","Type":"ContainerStarted","Data":"11b77165263a5bb6eccdb727b8d477eccd33c1bb148d887ea177049c335c2e37"}
Oct 30 18:47:43.650214 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:43.650164    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-h28j5" podStartSLOduration=3.139226227 podStartE2EDuration="4.650150532s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.510924305s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:47:43.64944702 +0000 UTC m=+602.527719840" watchObservedRunningTime="2026-10-30 18:47:43.650150532 +0000 UTC m=+602.528423351"
Oct 30 18:47:48.640558 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:48.640522    6064 generic.go:356] "Generic (PLEG): container finished" podID="044d187c-e0b6-4155-a23e-532b962c0b92" containerID="11b77165263a5bb6eccdb727b8d477eccd33c1bb148d887ea177049c335c2e37" exitCode=0
Oct 30 18:47:48.641021 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:48.640606    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-h28j5" event={"ID":"044d187c-e0b6-4155-a23e-532b962c0b92","Type":"ContainerDied","Data":"11b77165263a5bb6eccdb727b8d477eccd33c1bb148d887ea177049c335c2e37"}
Oct 30 18:47:49.774676 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.774632    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:49.881773 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.881748    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw\" (UniqueName: \"kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw\") pod \"044d187c-e0b6-4155-a23e-532b962c0b92\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") "
Oct 30 18:47:49.881912 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.881784    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache\") pod \"044d187c-e0b6-4155-a23e-532b962c0b92\" (UID: \"044d187c-e0b6-4155-a23e-532b962c0b92\") "
Oct 30 18:47:49.883958 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.883925    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw" pod "044d187c-e0b6-4155-a23e-532b962c0b92" (UID: "044d187c-e0b6-4155-a23e-532b962c0b92"). InnerVolumeSpecName "kube-api-access-zbmmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:47:49.904973 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.904920    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache" pod "044d187c-e0b6-4155-a23e-532b962c0b92" (UID: "044d187c-e0b6-4155-a23e-532b962c0b92"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:47:49.982444 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.982419    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbmmw\" (UniqueName: \"kubernetes.io/projected/044d187c-e0b6-4155-a23e-532b962c0b92-kube-api-access-zbmmw\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:47:49.982444 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:49.982441    6064 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/044d187c-e0b6-4155-a23e-532b962c0b92-model-cache\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:47:50.649610 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:50.649585    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-h28j5"
Oct 30 18:47:50.649610 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:50.649597    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-h28j5" event={"ID":"044d187c-e0b6-4155-a23e-532b962c0b92","Type":"ContainerDied","Data":"7d640defbf66dd2aee43db134e018a1cc7a1cf92dd155b9d0864ff3d5624c002"}
Oct 30 18:47:50.649810 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:50.649628    6064 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d640defbf66dd2aee43db134e018a1cc7a1cf92dd155b9d0864ff3d5624c002"
Oct 30 18:47:53.060248 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:47:53.060211    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:47:54.187421 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.187379    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-lcn5z"]
Oct 30 18:47:54.187848 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.187828    6064 cpu_manager.go:414] "containerMap: removing container" podUID="044d187c-e0b6-4155-a23e-532b962c0b92" containerName="download-hf-model"
Oct 30 18:47:54.187894 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.187849    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="044d187c-e0b6-4155-a23e-532b962c0b92" containerName="download-hf-model"
Oct 30 18:47:54.187894 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.187867    6064 cpu_manager.go:414] "containerMap: removing container" podUID="044d187c-e0b6-4155-a23e-532b962c0b92" containerName="s3-tls-init-custom"
Oct 30 18:47:54.187894 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.187872    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="044d187c-e0b6-4155-a23e-532b962c0b92" containerName="s3-tls-init-custom"
Oct 30 18:47:54.187987 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.187941    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="044d187c-e0b6-4155-a23e-532b962c0b92" containerName="s3-tls-init-custom"
Oct 30 18:47:54.190870 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.190850    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.195605 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.195581    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 18:47:54.195605 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.195594    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Oct 30 18:47:54.195783 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.195606    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Oct 30 18:47:54.195783 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.195635    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 18:47:54.195783 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.195756    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x652p\""
Oct 30 18:47:54.202859 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.202838    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-lcn5z"]
Oct 30 18:47:54.312054 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.312023    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache\") pod \"s3-tls-init-serving-lcn5z\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") " pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.312154 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.312066    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2bg5\" (UniqueName: \"kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5\") pod \"s3-tls-init-serving-lcn5z\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") " pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.413065 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.413036    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache\") pod \"s3-tls-init-serving-lcn5z\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") " pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.413163 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.413076    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2bg5\" (UniqueName: \"kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5\") pod \"s3-tls-init-serving-lcn5z\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") " pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.413402 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.413381    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache\") pod \"s3-tls-init-serving-lcn5z\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") " pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.426142 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.426117    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2bg5\" (UniqueName: \"kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5\") pod \"s3-tls-init-serving-lcn5z\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") " pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.522288 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.522230    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:47:54.797818 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:54.797749    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-lcn5z"]
Oct 30 18:47:54.801047 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:47:54.801021    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf9e467f_8be5_48b2_be77_bab481d41e80.slice/crio-92fcaeec48952ab453bbed64ac2a569b4b1215d463e1e7c9bed43774a29514d6 WatchSource:0}: Error finding container 92fcaeec48952ab453bbed64ac2a569b4b1215d463e1e7c9bed43774a29514d6: Status 404 returned error can't find the container with id 92fcaeec48952ab453bbed64ac2a569b4b1215d463e1e7c9bed43774a29514d6
Oct 30 18:47:55.668735 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:55.668698    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-lcn5z" event={"ID":"df9e467f-8be5-48b2-be77-bab481d41e80","Type":"ContainerStarted","Data":"6b7645658cb3cf50067e3a959e6ab9601e09042b5c34888f1dc332a214169e93"}
Oct 30 18:47:55.668735 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:55.668738    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-lcn5z" event={"ID":"df9e467f-8be5-48b2-be77-bab481d41e80","Type":"ContainerStarted","Data":"92fcaeec48952ab453bbed64ac2a569b4b1215d463e1e7c9bed43774a29514d6"}
Oct 30 18:47:56.673192 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:56.673161    6064 generic.go:356] "Generic (PLEG): container finished" podID="df9e467f-8be5-48b2-be77-bab481d41e80" containerID="6b7645658cb3cf50067e3a959e6ab9601e09042b5c34888f1dc332a214169e93" exitCode=0
Oct 30 18:47:56.673555 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:56.673250    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-lcn5z" event={"ID":"df9e467f-8be5-48b2-be77-bab481d41e80","Type":"ContainerDied","Data":"6b7645658cb3cf50067e3a959e6ab9601e09042b5c34888f1dc332a214169e93"}
Oct 30 18:47:57.679087 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:57.679047    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-lcn5z" event={"ID":"df9e467f-8be5-48b2-be77-bab481d41e80","Type":"ContainerStarted","Data":"5bf3a11a8b0c51e159658b75864a420954b7363dab4d832cf6db348a55e2091c"}
Oct 30 18:47:57.697428 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:47:57.697383    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-lcn5z" podStartSLOduration=2.118419531 podStartE2EDuration="3.697369854s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.578950323s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:47:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:47:57.696582602 +0000 UTC m=+616.574855422" watchObservedRunningTime="2026-10-30 18:47:57.697369854 +0000 UTC m=+616.575642668"
Oct 30 18:48:03.706040 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:03.706003    6064 generic.go:356] "Generic (PLEG): container finished" podID="df9e467f-8be5-48b2-be77-bab481d41e80" containerID="5bf3a11a8b0c51e159658b75864a420954b7363dab4d832cf6db348a55e2091c" exitCode=0
Oct 30 18:48:03.706429 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:03.706078    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-lcn5z" event={"ID":"df9e467f-8be5-48b2-be77-bab481d41e80","Type":"ContainerDied","Data":"5bf3a11a8b0c51e159658b75864a420954b7363dab4d832cf6db348a55e2091c"}
Oct 30 18:48:04.854636 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:04.854606    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:48:04.907317 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:04.907287    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache\") pod \"df9e467f-8be5-48b2-be77-bab481d41e80\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") "
Oct 30 18:48:04.907455 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:04.907379    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5\" (UniqueName: \"kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5\") pod \"df9e467f-8be5-48b2-be77-bab481d41e80\" (UID: \"df9e467f-8be5-48b2-be77-bab481d41e80\") "
Oct 30 18:48:04.909524 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:04.909490    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5" pod "df9e467f-8be5-48b2-be77-bab481d41e80" (UID: "df9e467f-8be5-48b2-be77-bab481d41e80"). InnerVolumeSpecName "kube-api-access-v2bg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:48:04.930298 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:04.930273    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache" pod "df9e467f-8be5-48b2-be77-bab481d41e80" (UID: "df9e467f-8be5-48b2-be77-bab481d41e80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:48:05.008592 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:05.008543    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2bg5\" (UniqueName: \"kubernetes.io/projected/df9e467f-8be5-48b2-be77-bab481d41e80-kube-api-access-v2bg5\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:48:05.008592 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:05.008563    6064 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9e467f-8be5-48b2-be77-bab481d41e80-model-cache\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:48:05.715838 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:05.715813    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-lcn5z"
Oct 30 18:48:05.715838 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:05.715823    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-lcn5z" event={"ID":"df9e467f-8be5-48b2-be77-bab481d41e80","Type":"ContainerDied","Data":"92fcaeec48952ab453bbed64ac2a569b4b1215d463e1e7c9bed43774a29514d6"}
Oct 30 18:48:05.716012 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:05.715856    6064 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92fcaeec48952ab453bbed64ac2a569b4b1215d463e1e7c9bed43774a29514d6"
Oct 30 18:48:23.059476 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:48:23.059389    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:48:23.324087 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.324012    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"]
Oct 30 18:48:23.324356 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.324343    6064 cpu_manager.go:414] "containerMap: removing container" podUID="df9e467f-8be5-48b2-be77-bab481d41e80" containerName="download-hf-model"
Oct 30 18:48:23.324397 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.324359    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df9e467f-8be5-48b2-be77-bab481d41e80" containerName="download-hf-model"
Oct 30 18:48:23.324397 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.324387    6064 cpu_manager.go:414] "containerMap: removing container" podUID="df9e467f-8be5-48b2-be77-bab481d41e80" containerName="s3-tls-init-serving"
Oct 30 18:48:23.324397 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.324392    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df9e467f-8be5-48b2-be77-bab481d41e80" containerName="s3-tls-init-serving"
Oct 30 18:48:23.324490 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.324453    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="df9e467f-8be5-48b2-be77-bab481d41e80" containerName="s3-tls-init-serving"
Oct 30 18:48:23.328013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.327998    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.350954 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.350933    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-pmml-v2-kserve-predictor-serving-cert\""
Oct 30 18:48:23.355142 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.355119    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 18:48:23.355142 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.355131    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 18:48:23.357272 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.357258    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 18:48:23.357383 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.357368    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:48:23.357418 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.357376    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-pmml-v2-kserve-kube-rbac-proxy-sar-config\""
Oct 30 18:48:23.357506 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.357496    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 18:48:23.360042 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.360022    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"]
Oct 30 18:48:23.444057 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.444025    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.444177 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.444128    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpx6\" (UniqueName: \"kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.444177 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.444167    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.444259 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.444234    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.444338 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.444318    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.544775 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.544736    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.544953 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.544798    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpx6\" (UniqueName: \"kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.544953 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.544827    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.544953 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.544851    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.544953 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.544887    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.545301 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.545278    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.545465 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.545444    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.545559 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.545541    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.547493 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.547472    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.557852 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.557825    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpx6\" (UniqueName: \"kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6\") pod \"isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") " pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.645132 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.645103    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:23.929005 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:23.928928    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"]
Oct 30 18:48:23.932051 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:48:23.932017    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d517a23_a077_4dfe_9c52_97715e6c4271.slice/crio-6abb83183ac9f376552857146a18241e1c5c3ef974a87005534ea51cf04c768d WatchSource:0}: Error finding container 6abb83183ac9f376552857146a18241e1c5c3ef974a87005534ea51cf04c768d: Status 404 returned error can't find the container with id 6abb83183ac9f376552857146a18241e1c5c3ef974a87005534ea51cf04c768d
Oct 30 18:48:24.789837 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:24.789804    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerStarted","Data":"d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6"}
Oct 30 18:48:24.790222 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:24.789864    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerStarted","Data":"6abb83183ac9f376552857146a18241e1c5c3ef974a87005534ea51cf04c768d"}
Oct 30 18:48:28.811304 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:28.811269    6064 generic.go:356] "Generic (PLEG): container finished" podID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerID="d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6" exitCode=0
Oct 30 18:48:28.811819 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:28.811349    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerDied","Data":"d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6"}
Oct 30 18:48:36.850817 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:36.850781    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerStarted","Data":"883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72"}
Oct 30 18:48:38.861145 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:38.861109    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerStarted","Data":"03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a"}
Oct 30 18:48:38.861577 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:38.861319    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:38.861577 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:38.861450    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:38.862586 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:38.862556    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:48:38.885691 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:38.885537    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podStartSLOduration=2.241369974 podStartE2EDuration="15.885520661s" totalImagesPullingTime="9.76770412s" totalInitContainerRuntime="3.876446567s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:48:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:48:38.883881399 +0000 UTC m=+657.762154220" watchObservedRunningTime="2026-10-30 18:48:38.885520661 +0000 UTC m=+657.763793492"
Oct 30 18:48:39.865118 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:39.865080    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:48:44.870087 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:44.870051    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:48:44.870543 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:44.870516    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:48:53.058614 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:48:53.058574    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:48:54.870853 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:48:54.870807    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:49:04.871488 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:49:04.871449    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:49:14.870506 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:49:14.870464    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:49:23.058970 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:49:23.058923    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:49:24.870574 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:49:24.870535    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:49:34.870853 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:49:34.870816    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:49:44.871049 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:49:44.871007    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:49:53.059802 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:49:53.059726    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:49:54.870876 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:49:54.870836    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 18:50:03.237695 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:03.237639    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:50:15.285691 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:15.285613    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"]
Oct 30 18:50:15.286156 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:15.285900    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container" containerID="cri-o://883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72" gracePeriod=30
Oct 30 18:50:15.286156 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:15.285927    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kube-rbac-proxy" containerID="cri-o://03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a" gracePeriod=30
Oct 30 18:50:16.238138 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:16.238107    6064 generic.go:356] "Generic (PLEG): container finished" podID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerID="03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a" exitCode=0
Oct 30 18:50:16.238306 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:16.238192    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerDied","Data":"03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a"}
Oct 30 18:50:18.829954 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.829930    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:50:18.934212 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934178    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert\") pod \"4d517a23-a077-4dfe-9c52-97715e6c4271\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") "
Oct 30 18:50:18.934349 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934223    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config\") pod \"4d517a23-a077-4dfe-9c52-97715e6c4271\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") "
Oct 30 18:50:18.934349 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934269    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls\") pod \"4d517a23-a077-4dfe-9c52-97715e6c4271\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") "
Oct 30 18:50:18.934349 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934299    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location\") pod \"4d517a23-a077-4dfe-9c52-97715e6c4271\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") "
Oct 30 18:50:18.934519 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934438    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6\" (UniqueName: \"kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6\") pod \"4d517a23-a077-4dfe-9c52-97715e6c4271\" (UID: \"4d517a23-a077-4dfe-9c52-97715e6c4271\") "
Oct 30 18:50:18.934603 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934582    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location" pod "4d517a23-a077-4dfe-9c52-97715e6c4271" (UID: "4d517a23-a077-4dfe-9c52-97715e6c4271"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:50:18.934686 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934638    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert" pod "4d517a23-a077-4dfe-9c52-97715e6c4271" (UID: "4d517a23-a077-4dfe-9c52-97715e6c4271"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:50:18.934752 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934698    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config" pod "4d517a23-a077-4dfe-9c52-97715e6c4271" (UID: "4d517a23-a077-4dfe-9c52-97715e6c4271"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:50:18.934809 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934752    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d517a23-a077-4dfe-9c52-97715e6c4271-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:50:18.934809 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934764    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:50:18.934809 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.934777    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:50:18.936743 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.936710    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6" pod "4d517a23-a077-4dfe-9c52-97715e6c4271" (UID: "4d517a23-a077-4dfe-9c52-97715e6c4271"). InnerVolumeSpecName "kube-api-access-2bpx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:50:18.936821 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:18.936756    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls" pod "4d517a23-a077-4dfe-9c52-97715e6c4271" (UID: "4d517a23-a077-4dfe-9c52-97715e6c4271"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:50:19.035311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.035290    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bpx6\" (UniqueName: \"kubernetes.io/projected/4d517a23-a077-4dfe-9c52-97715e6c4271-kube-api-access-2bpx6\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:50:19.035311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.035312    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d517a23-a077-4dfe-9c52-97715e6c4271-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:50:19.250753 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.250727    6064 generic.go:356] "Generic (PLEG): container finished" podID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerID="883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72" exitCode=0
Oct 30 18:50:19.250846 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.250777    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerDied","Data":"883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72"}
Oct 30 18:50:19.250846 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.250793    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"
Oct 30 18:50:19.250846 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.250820    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn" event={"ID":"4d517a23-a077-4dfe-9c52-97715e6c4271","Type":"ContainerDied","Data":"6abb83183ac9f376552857146a18241e1c5c3ef974a87005534ea51cf04c768d"}
Oct 30 18:50:19.250846 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.250845    6064 scope.go:122] "RemoveContainer" containerID="03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a"
Oct 30 18:50:19.259559 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.259541    6064 scope.go:122] "RemoveContainer" containerID="883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72"
Oct 30 18:50:19.267139 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.267122    6064 scope.go:122] "RemoveContainer" containerID="d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6"
Oct 30 18:50:19.267476 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.267455    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"]
Oct 30 18:50:19.272574 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.272549    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-pmml-v2-kserve-predictor-cc78fd7-ww8fn"]
Oct 30 18:50:19.275391 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.275358    6064 scope.go:122] "RemoveContainer" containerID="03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a"
Oct 30 18:50:19.275679 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:50:19.275645    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a\": container with ID starting with 03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a not found: ID does not exist" containerID="03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a"
Oct 30 18:50:19.275757 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.275691    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a"} err="failed to get container status \"03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a\": rpc error: code = NotFound desc = could not find container \"03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a\": container with ID starting with 03c08289af4bda72116a844c7f822aeda927bced3fb0d85e07b6f1c07742095a not found: ID does not exist"
Oct 30 18:50:19.275757 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.275716    6064 scope.go:122] "RemoveContainer" containerID="883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72"
Oct 30 18:50:19.275976 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:50:19.275957    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72\": container with ID starting with 883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72 not found: ID does not exist" containerID="883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72"
Oct 30 18:50:19.276020 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.275982    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72"} err="failed to get container status \"883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72\": rpc error: code = NotFound desc = could not find container \"883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72\": container with ID starting with 883021920fc799bb3a89091322b50505ab66f676bad1d287959e8b462c24ad72 not found: ID does not exist"
Oct 30 18:50:19.276020 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.275999    6064 scope.go:122] "RemoveContainer" containerID="d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6"
Oct 30 18:50:19.276228 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:50:19.276213    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6\": container with ID starting with d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6 not found: ID does not exist" containerID="d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6"
Oct 30 18:50:19.276269 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:19.276231    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6"} err="failed to get container status \"d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6\": rpc error: code = NotFound desc = could not find container \"d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6\": container with ID starting with d28bddd2c8d760fc94eff960da712577b56f3297b713c836db61b958f9b4a4b6 not found: ID does not exist"
Oct 30 18:50:21.237981 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:50:21.237945    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" path="/var/lib/kubelet/pods/4d517a23-a077-4dfe-9c52-97715e6c4271/volumes"
Oct 30 18:50:23.062211 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:50:23.062174    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:50:53.060821 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:50:53.060782    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:51:23.065692 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:51:23.064390    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:51:53.060940 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:51:53.060900    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:52:23.065448 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:52:23.065405    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:52:41.332520 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:41.332490    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:52:41.336184 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:41.336162    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:52:46.854324 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854293    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"]
Oct 30 18:52:46.854822 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854803    6064 cpu_manager.go:414] "containerMap: removing container" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container"
Oct 30 18:52:46.854945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854825    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container"
Oct 30 18:52:46.854945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854864    6064 cpu_manager.go:414] "containerMap: removing container" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kube-rbac-proxy"
Oct 30 18:52:46.854945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854870    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kube-rbac-proxy"
Oct 30 18:52:46.854945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854882    6064 cpu_manager.go:414] "containerMap: removing container" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="storage-initializer"
Oct 30 18:52:46.854945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854889    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="storage-initializer"
Oct 30 18:52:46.854945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854941    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kube-rbac-proxy"
Oct 30 18:52:46.855156 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.854953    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d517a23-a077-4dfe-9c52-97715e6c4271" containerName="kserve-container"
Oct 30 18:52:46.858217 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.858196    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:46.869142 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.869117    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 18:52:46.869223 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.869151    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 18:52:46.869457 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.869446    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 18:52:46.869795 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.869779    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 18:52:46.869959 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.869946    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-sklearn-predictor-serving-cert\""
Oct 30 18:52:46.871034 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.871018    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-sklearn-kube-rbac-proxy-sar-config\""
Oct 30 18:52:46.875416 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.875396    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"]
Oct 30 18:52:46.969762 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:46.969738    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:52:47.022080 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.022053    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8dml\" (UniqueName: \"kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.022188 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.022085    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.022188 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.022117    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.022273 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.022219    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.022273 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.022253    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.123477 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.123412    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.123477 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.123448    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.123687 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.123477    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.123687 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.123557    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8dml\" (UniqueName: \"kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.123687 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.123582    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.123933 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.123904    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.124629 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.124597    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.124760 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.124597    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.126827 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.126797    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.138259 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.138227    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8dml\" (UniqueName: \"kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml\") pod \"isvc-predictive-sklearn-predictor-5988679555-8kzlg\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.175076 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.175053    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:52:47.470552 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.470479    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"]
Oct 30 18:52:47.474224 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:52:47.474191    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d9cc04_8861_46f7_b746_b635402c8841.slice/crio-677ad3cf1665ddc347b57844a8a6483336b17bb92c5ce1a87be1927664e66af0 WatchSource:0}: Error finding container 677ad3cf1665ddc347b57844a8a6483336b17bb92c5ce1a87be1927664e66af0: Status 404 returned error can't find the container with id 677ad3cf1665ddc347b57844a8a6483336b17bb92c5ce1a87be1927664e66af0
Oct 30 18:52:47.822508 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.822428    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerStarted","Data":"78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7"}
Oct 30 18:52:47.822508 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:47.822484    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerStarted","Data":"677ad3cf1665ddc347b57844a8a6483336b17bb92c5ce1a87be1927664e66af0"}
Oct 30 18:52:51.844229 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:51.844202    6064 generic.go:356] "Generic (PLEG): container finished" podID="f7d9cc04-8861-46f7-b746-b635402c8841" containerID="78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7" exitCode=0
Oct 30 18:52:51.844587 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:51.844279    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerDied","Data":"78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7"}
Oct 30 18:52:51.845604 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:52:51.845588    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 18:52:53.071138 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:52:53.071072    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:53:14.963700 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:14.963645    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerStarted","Data":"61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3"}
Oct 30 18:53:14.964129 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:14.963722    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerStarted","Data":"98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16"}
Oct 30 18:53:14.964129 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:14.963901    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:53:14.985181 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:14.985134    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podStartSLOduration=3.014574302 podStartE2EDuration="28.985111469s" totalImagesPullingTime="22.188716738s" totalInitContainerRuntime="3.781820429s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:53:14.984335272 +0000 UTC m=+933.862608090" watchObservedRunningTime="2026-10-30 18:53:14.985111469 +0000 UTC m=+933.863384291"
Oct 30 18:53:15.967945 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:15.967916    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:53:15.969038 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:15.969011    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:53:16.971784 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:16.971744    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:53:21.976271 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:21.976242    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:53:21.976775 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:21.976747    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:53:23.059125 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:53:23.059086    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:53:31.977474 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:31.977437    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:53:41.976910 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:41.976866    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:53:51.977215 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:53:51.977177    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:53:53.060042 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:53:53.060000    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:54:01.976802 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:01.976759    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:54:11.977177 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:11.977137    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Oct 30 18:54:21.977900 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:21.977800    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:54:23.060524 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:54:23.060485    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:54:27.676667 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:27.676621    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"]
Oct 30 18:54:27.677041 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:27.676894    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container" containerID="cri-o://98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16" gracePeriod=30
Oct 30 18:54:27.677041 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:27.676981    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kube-rbac-proxy" containerID="cri-o://61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3" gracePeriod=30
Oct 30 18:54:28.249360 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:28.249325    6064 generic.go:356] "Generic (PLEG): container finished" podID="f7d9cc04-8861-46f7-b746-b635402c8841" containerID="61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3" exitCode=0
Oct 30 18:54:28.249517 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:28.249398    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerDied","Data":"61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3"}
Oct 30 18:54:31.721359 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.721337    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:54:31.837790 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.837761    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location\") pod \"f7d9cc04-8861-46f7-b746-b635402c8841\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") "
Oct 30 18:54:31.837944 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.837805    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config\") pod \"f7d9cc04-8861-46f7-b746-b635402c8841\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") "
Oct 30 18:54:31.837944 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.837823    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml\" (UniqueName: \"kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml\") pod \"f7d9cc04-8861-46f7-b746-b635402c8841\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") "
Oct 30 18:54:31.837944 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.837862    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls\") pod \"f7d9cc04-8861-46f7-b746-b635402c8841\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") "
Oct 30 18:54:31.837944 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.837926    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert\") pod \"f7d9cc04-8861-46f7-b746-b635402c8841\" (UID: \"f7d9cc04-8861-46f7-b746-b635402c8841\") "
Oct 30 18:54:31.838181 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.838150    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location" pod "f7d9cc04-8861-46f7-b746-b635402c8841" (UID: "f7d9cc04-8861-46f7-b746-b635402c8841"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:54:31.838300 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.838271    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config" pod "f7d9cc04-8861-46f7-b746-b635402c8841" (UID: "f7d9cc04-8861-46f7-b746-b635402c8841"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:54:31.838409 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.838329    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert" pod "f7d9cc04-8861-46f7-b746-b635402c8841" (UID: "f7d9cc04-8861-46f7-b746-b635402c8841"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:54:31.840139 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.840117    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml" pod "f7d9cc04-8861-46f7-b746-b635402c8841" (UID: "f7d9cc04-8861-46f7-b746-b635402c8841"). InnerVolumeSpecName "kube-api-access-c8dml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:54:31.840210 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.840119    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls" pod "f7d9cc04-8861-46f7-b746-b635402c8841" (UID: "f7d9cc04-8861-46f7-b746-b635402c8841"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:54:31.939040 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.939014    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7d9cc04-8861-46f7-b746-b635402c8841-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:31.939040 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.939036    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:31.939189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.939046    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8dml\" (UniqueName: \"kubernetes.io/projected/f7d9cc04-8861-46f7-b746-b635402c8841-kube-api-access-c8dml\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:31.939189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.939055    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f7d9cc04-8861-46f7-b746-b635402c8841-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:31.939189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:31.939065    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f7d9cc04-8861-46f7-b746-b635402c8841-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:54:32.266415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.266339    6064 generic.go:356] "Generic (PLEG): container finished" podID="f7d9cc04-8861-46f7-b746-b635402c8841" containerID="98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16" exitCode=0
Oct 30 18:54:32.266415 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.266400    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"
Oct 30 18:54:32.266590 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.266414    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerDied","Data":"98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16"}
Oct 30 18:54:32.266590 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.266467    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg" event={"ID":"f7d9cc04-8861-46f7-b746-b635402c8841","Type":"ContainerDied","Data":"677ad3cf1665ddc347b57844a8a6483336b17bb92c5ce1a87be1927664e66af0"}
Oct 30 18:54:32.266590 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.266494    6064 scope.go:122] "RemoveContainer" containerID="61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3"
Oct 30 18:54:32.275555 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.275537    6064 scope.go:122] "RemoveContainer" containerID="98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16"
Oct 30 18:54:32.283264 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.283249    6064 scope.go:122] "RemoveContainer" containerID="78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7"
Oct 30 18:54:32.287190 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.287173    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"]
Oct 30 18:54:32.290976 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.290955    6064 scope.go:122] "RemoveContainer" containerID="61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3"
Oct 30 18:54:32.291249 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:54:32.291231    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3\": container with ID starting with 61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3 not found: ID does not exist" containerID="61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3"
Oct 30 18:54:32.291308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.291258    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3"} err="failed to get container status \"61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3\": rpc error: code = NotFound desc = could not find container \"61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3\": container with ID starting with 61d71b50ab1ac19c54a3c9e9ffe76b815290babcdccce72b13115b7fc183d6d3 not found: ID does not exist"
Oct 30 18:54:32.291308 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.291274    6064 scope.go:122] "RemoveContainer" containerID="98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16"
Oct 30 18:54:32.291512 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:54:32.291493    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16\": container with ID starting with 98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16 not found: ID does not exist" containerID="98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16"
Oct 30 18:54:32.291583 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.291522    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16"} err="failed to get container status \"98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16\": rpc error: code = NotFound desc = could not find container \"98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16\": container with ID starting with 98f0458c4b88201ba3644cab2f69aeb9dc54f4a8546325fdefc048fb47f29c16 not found: ID does not exist"
Oct 30 18:54:32.291583 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.291546    6064 scope.go:122] "RemoveContainer" containerID="78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7"
Oct 30 18:54:32.291782 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:54:32.291765    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7\": container with ID starting with 78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7 not found: ID does not exist" containerID="78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7"
Oct 30 18:54:32.291829 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.291786    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7"} err="failed to get container status \"78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7\": rpc error: code = NotFound desc = could not find container \"78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7\": container with ID starting with 78b210ccb95b501c92e8593a918efcc36c9ccf67dbd0c33aa18e7f827352ecf7 not found: ID does not exist"
Oct 30 18:54:32.294012 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:32.293990    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-predictor-5988679555-8kzlg"]
Oct 30 18:54:33.170391 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170363    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"]
Oct 30 18:54:33.170869 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170848    6064 cpu_manager.go:414] "containerMap: removing container" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kube-rbac-proxy"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170873    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kube-rbac-proxy"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170901    6064 cpu_manager.go:414] "containerMap: removing container" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170910    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170944    6064 cpu_manager.go:414] "containerMap: removing container" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="storage-initializer"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.170954    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="storage-initializer"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.171036    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kube-rbac-proxy"
Oct 30 18:54:33.171148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.171046    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" containerName="kserve-container"
Oct 30 18:54:33.175707 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.175687    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.183729 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.183707    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-xgboost-predictor-serving-cert\""
Oct 30 18:54:33.184059 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.184030    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 18:54:33.184059 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.184046    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:54:33.184192 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.184078    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 18:54:33.184192 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.184093    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 18:54:33.184461 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.184448    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 18:54:33.184507 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.184481    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-xgboost-kube-rbac-proxy-sar-config\""
Oct 30 18:54:33.187045 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.187025    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"]
Oct 30 18:54:33.237528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.237500    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7d9cc04-8861-46f7-b746-b635402c8841" path="/var/lib/kubelet/pods/f7d9cc04-8861-46f7-b746-b635402c8841/volumes"
Oct 30 18:54:33.249814 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.249793    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.249890 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.249833    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.249940 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.249898    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.249940 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.249925    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.250039 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.249952    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgm5\" (UniqueName: \"kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.350797 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.350771    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.350940 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.350811    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.350940 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.350832    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.350940 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.350854    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.350940 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.350881    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgm5\" (UniqueName: \"kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.351265 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.351243    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.351518 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.351500    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.351560 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.351546    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.353673 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.353635    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.362771 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.362748    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgm5\" (UniqueName: \"kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5\") pod \"isvc-predictive-xgboost-predictor-678c667c44-lk8f5\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.493361 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.493304    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:33.772094 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:33.772015    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"]
Oct 30 18:54:33.776282 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:54:33.776250    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91065fc_c199_430c_836e_9401a789f829.slice/crio-e34c702d1d49cd18fc3837ff91f30ab0536b3044bb6168614c58c6cd0d34324c WatchSource:0}: Error finding container e34c702d1d49cd18fc3837ff91f30ab0536b3044bb6168614c58c6cd0d34324c: Status 404 returned error can't find the container with id e34c702d1d49cd18fc3837ff91f30ab0536b3044bb6168614c58c6cd0d34324c
Oct 30 18:54:34.275526 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:34.275489    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerStarted","Data":"58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b"}
Oct 30 18:54:34.276013 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:34.275559    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerStarted","Data":"e34c702d1d49cd18fc3837ff91f30ab0536b3044bb6168614c58c6cd0d34324c"}
Oct 30 18:54:38.293823 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:38.293789    6064 generic.go:356] "Generic (PLEG): container finished" podID="e91065fc-c199-430c-836e-9401a789f829" containerID="58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b" exitCode=0
Oct 30 18:54:38.294244 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:38.293863    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerDied","Data":"58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b"}
Oct 30 18:54:39.301034 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:39.300997    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerStarted","Data":"2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437"}
Oct 30 18:54:39.301447 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:39.301061    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerStarted","Data":"f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32"}
Oct 30 18:54:39.301447 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:39.301298    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:39.326886 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:39.326832    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podStartSLOduration=2.499769591 podStartE2EDuration="6.326817667s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.827048076s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:54:39.326015553 +0000 UTC m=+1018.204288373" watchObservedRunningTime="2026-10-30 18:54:39.326817667 +0000 UTC m=+1018.205090488"
Oct 30 18:54:40.305574 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:40.305536    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:40.306811 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:40.306780    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:54:41.309570 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:41.309537    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:54:46.313690 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:46.313646    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:54:46.314253 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:46.314224    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:54:53.058867 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:54:53.058827    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:54:56.314881 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:54:56.314835    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:55:06.314262 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:06.314224    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:55:16.314528 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:16.314486    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:55:23.060388 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:55:23.060345    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:55:26.314533 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:26.314493    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:55:36.315585 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:36.315549    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:55:43.980150 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:43.980117    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"]
Oct 30 18:55:43.980628 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:43.980352    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" containerID="cri-o://f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32" gracePeriod=30
Oct 30 18:55:43.980628 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:43.980389    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kube-rbac-proxy" containerID="cri-o://2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437" gracePeriod=30
Oct 30 18:55:44.550448 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:44.550412    6064 generic.go:356] "Generic (PLEG): container finished" podID="e91065fc-c199-430c-836e-9401a789f829" containerID="2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437" exitCode=0
Oct 30 18:55:44.550641 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:44.550475    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerDied","Data":"2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437"}
Oct 30 18:55:46.310600 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:46.310560    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Oct 30 18:55:46.314891 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:46.314865    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Oct 30 18:55:48.019149 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.019126    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:55:48.128665 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.128631    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location\") pod \"e91065fc-c199-430c-836e-9401a789f829\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") "
Oct 30 18:55:48.128801 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.128747    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5\" (UniqueName: \"kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5\") pod \"e91065fc-c199-430c-836e-9401a789f829\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") "
Oct 30 18:55:48.128866 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.128799    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls\") pod \"e91065fc-c199-430c-836e-9401a789f829\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") "
Oct 30 18:55:48.128866 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.128839    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert\") pod \"e91065fc-c199-430c-836e-9401a789f829\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") "
Oct 30 18:55:48.128970 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.128898    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config\") pod \"e91065fc-c199-430c-836e-9401a789f829\" (UID: \"e91065fc-c199-430c-836e-9401a789f829\") "
Oct 30 18:55:48.128970 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.128903    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location" pod "e91065fc-c199-430c-836e-9401a789f829" (UID: "e91065fc-c199-430c-836e-9401a789f829"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:55:48.129143 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.129126    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e91065fc-c199-430c-836e-9401a789f829-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:55:48.129220 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.129205    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert" pod "e91065fc-c199-430c-836e-9401a789f829" (UID: "e91065fc-c199-430c-836e-9401a789f829"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:55:48.129273 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.129210    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config" pod "e91065fc-c199-430c-836e-9401a789f829" (UID: "e91065fc-c199-430c-836e-9401a789f829"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:55:48.130942 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.130924    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls" pod "e91065fc-c199-430c-836e-9401a789f829" (UID: "e91065fc-c199-430c-836e-9401a789f829"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:55:48.131040 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.131003    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5" pod "e91065fc-c199-430c-836e-9401a789f829" (UID: "e91065fc-c199-430c-836e-9401a789f829"). InnerVolumeSpecName "kube-api-access-mfgm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:55:48.230349 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.230324    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e91065fc-c199-430c-836e-9401a789f829-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:55:48.230349 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.230345    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:55:48.230473 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.230355    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e91065fc-c199-430c-836e-9401a789f829-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:55:48.230473 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.230364    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfgm5\" (UniqueName: \"kubernetes.io/projected/e91065fc-c199-430c-836e-9401a789f829-kube-api-access-mfgm5\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:55:48.567968 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.567891    6064 generic.go:356] "Generic (PLEG): container finished" podID="e91065fc-c199-430c-836e-9401a789f829" containerID="f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32" exitCode=0
Oct 30 18:55:48.567968 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.567938    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerDied","Data":"f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32"}
Oct 30 18:55:48.567968 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.567947    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"
Oct 30 18:55:48.568203 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.567984    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5" event={"ID":"e91065fc-c199-430c-836e-9401a789f829","Type":"ContainerDied","Data":"e34c702d1d49cd18fc3837ff91f30ab0536b3044bb6168614c58c6cd0d34324c"}
Oct 30 18:55:48.568203 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.568011    6064 scope.go:122] "RemoveContainer" containerID="2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437"
Oct 30 18:55:48.577931 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.577906    6064 scope.go:122] "RemoveContainer" containerID="f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32"
Oct 30 18:55:48.585594 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.585573    6064 scope.go:122] "RemoveContainer" containerID="58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b"
Oct 30 18:55:48.592243 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.592219    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"]
Oct 30 18:55:48.593148 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.593128    6064 scope.go:122] "RemoveContainer" containerID="2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437"
Oct 30 18:55:48.593397 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:55:48.593380    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437\": container with ID starting with 2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437 not found: ID does not exist" containerID="2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437"
Oct 30 18:55:48.593466 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.593404    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437"} err="failed to get container status \"2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437\": rpc error: code = NotFound desc = could not find container \"2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437\": container with ID starting with 2e7d8ad2ac6fab8910b30e323ea5b487b79eb00b003828007b35022df1cc7437 not found: ID does not exist"
Oct 30 18:55:48.593466 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.593421    6064 scope.go:122] "RemoveContainer" containerID="f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32"
Oct 30 18:55:48.593633 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:55:48.593617    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32\": container with ID starting with f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32 not found: ID does not exist" containerID="f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32"
Oct 30 18:55:48.593696 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.593638    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32"} err="failed to get container status \"f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32\": rpc error: code = NotFound desc = could not find container \"f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32\": container with ID starting with f4a92155f878352b574088582d1d5f35292461b8fc262987d57463ce887c6c32 not found: ID does not exist"
Oct 30 18:55:48.593696 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.593664    6064 scope.go:122] "RemoveContainer" containerID="58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b"
Oct 30 18:55:48.593890 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:55:48.593873    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b\": container with ID starting with 58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b not found: ID does not exist" containerID="58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b"
Oct 30 18:55:48.593943 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.593896    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b"} err="failed to get container status \"58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b\": rpc error: code = NotFound desc = could not find container \"58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b\": container with ID starting with 58213f2c617e199320c21884c7ad12e2c738948ea67b6e84af85d3c1a914b68b not found: ID does not exist"
Oct 30 18:55:48.597129 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:48.597110    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-xgboost-predictor-678c667c44-lk8f5"]
Oct 30 18:55:49.237749 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.237712    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e91065fc-c199-430c-836e-9401a789f829" path="/var/lib/kubelet/pods/e91065fc-c199-430c-836e-9401a789f829/volumes"
Oct 30 18:55:49.471517 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.471469    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"]
Oct 30 18:55:49.472132 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472105    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="storage-initializer"
Oct 30 18:55:49.472132 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472131    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="storage-initializer"
Oct 30 18:55:49.472311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472160    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container"
Oct 30 18:55:49.472311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472169    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container"
Oct 30 18:55:49.472311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472194    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kube-rbac-proxy"
Oct 30 18:55:49.472311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472201    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kube-rbac-proxy"
Oct 30 18:55:49.472311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472295    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kserve-container"
Oct 30 18:55:49.472311 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.472307    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="e91065fc-c199-430c-836e-9401a789f829" containerName="kube-rbac-proxy"
Oct 30 18:55:49.476947 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.476927    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.490724 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.490641    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 18:55:49.490837 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.490717    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"]
Oct 30 18:55:49.490903 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.490864    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 18:55:49.490963 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.490938    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-lightgbm-predictor-serving-cert\""
Oct 30 18:55:49.491778 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.491754    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:55:49.491778 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.491770    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-lightgbm-kube-rbac-proxy-sar-config\""
Oct 30 18:55:49.491778 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.491759    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 18:55:49.491979 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.491789    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 18:55:49.640512 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.640480    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgw6n\" (UniqueName: \"kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.640512 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.640514    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.640732 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.640620    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.640732 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.640677    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.640798 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.640743    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.741897 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.741829    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.741897 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.741865    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.741897 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.741882    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.742139 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.741911    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgw6n\" (UniqueName: \"kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.742139 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.741946    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.742397 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.742377    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.742624 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.742604    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.742684 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.742626    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.744585 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.744564    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.757187 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.757163    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgw6n\" (UniqueName: \"kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n\") pod \"isvc-predictive-lightgbm-predictor-b8947fc65-46rfm\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:49.794032 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:49.793996    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:50.075902 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:50.075820    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"]
Oct 30 18:55:50.079486 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:55:50.079452    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75f4dd5_98f1_4fc4_90bd_df5d2928b198.slice/crio-f3ab40a329df62f4c0a713c0eb8d1202a8693fef1862e2404372d22f98b62f4b WatchSource:0}: Error finding container f3ab40a329df62f4c0a713c0eb8d1202a8693fef1862e2404372d22f98b62f4b: Status 404 returned error can't find the container with id f3ab40a329df62f4c0a713c0eb8d1202a8693fef1862e2404372d22f98b62f4b
Oct 30 18:55:50.579290 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:50.579256    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerStarted","Data":"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"}
Oct 30 18:55:50.579649 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:50.579314    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerStarted","Data":"f3ab40a329df62f4c0a713c0eb8d1202a8693fef1862e2404372d22f98b62f4b"}
Oct 30 18:55:53.059703 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:55:53.059606    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:55:54.595951 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:54.595917    6064 generic.go:356] "Generic (PLEG): container finished" podID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerID="cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41" exitCode=0
Oct 30 18:55:54.596320 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:54.595994    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerDied","Data":"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"}
Oct 30 18:55:55.601892 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:55.601860    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerStarted","Data":"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"}
Oct 30 18:55:55.602285 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:55.601929    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerStarted","Data":"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"}
Oct 30 18:55:55.602285 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:55.602210    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:55.602363 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:55.602350    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:55:55.603764 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:55.603739    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 18:55:55.653368 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:55.653322    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" podStartSLOduration=2.830300399 podStartE2EDuration="6.653309235s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.823008836s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:55:55.651814031 +0000 UTC m=+1094.530086863" watchObservedRunningTime="2026-10-30 18:55:55.653309235 +0000 UTC m=+1094.531582106"
Oct 30 18:55:56.606647 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:55:56.606606    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Oct 30 18:56:01.611314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:01.611283    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:56:01.612391 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:01.612371    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:56:09.737189 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:09.737152    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"]
Oct 30 18:56:09.737544 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:09.737409    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kserve-container" containerID="cri-o://0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63" gracePeriod=30
Oct 30 18:56:09.737544 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:09.737443    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kube-rbac-proxy" containerID="cri-o://dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51" gracePeriod=30
Oct 30 18:56:10.381051 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.381024    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:56:10.403241 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403219    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls\") pod \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") "
Oct 30 18:56:10.403351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403259    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert\") pod \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") "
Oct 30 18:56:10.403351 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403287    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config\") pod \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") "
Oct 30 18:56:10.403465 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403366    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location\") pod \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") "
Oct 30 18:56:10.403465 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403418    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n\" (UniqueName: \"kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n\") pod \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\" (UID: \"e75f4dd5-98f1-4fc4-90bd-df5d2928b198\") "
Oct 30 18:56:10.403673 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403627    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert" pod "e75f4dd5-98f1-4fc4-90bd-df5d2928b198" (UID: "e75f4dd5-98f1-4fc4-90bd-df5d2928b198"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:56:10.403735 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403697    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location" pod "e75f4dd5-98f1-4fc4-90bd-df5d2928b198" (UID: "e75f4dd5-98f1-4fc4-90bd-df5d2928b198"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:56:10.403735 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.403693    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config" pod "e75f4dd5-98f1-4fc4-90bd-df5d2928b198" (UID: "e75f4dd5-98f1-4fc4-90bd-df5d2928b198"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:56:10.405740 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.405705    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls" pod "e75f4dd5-98f1-4fc4-90bd-df5d2928b198" (UID: "e75f4dd5-98f1-4fc4-90bd-df5d2928b198"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:56:10.406327 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.406297    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n" pod "e75f4dd5-98f1-4fc4-90bd-df5d2928b198" (UID: "e75f4dd5-98f1-4fc4-90bd-df5d2928b198"). InnerVolumeSpecName "kube-api-access-wgw6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:56:10.504553 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.504503    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgw6n\" (UniqueName: \"kubernetes.io/projected/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-api-access-wgw6n\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:10.504553 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.504526    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:10.504553 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.504535    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:10.504553 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.504544    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:10.504553 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.504553    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75f4dd5-98f1-4fc4-90bd-df5d2928b198-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:56:10.665426 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665395    6064 generic.go:356] "Generic (PLEG): container finished" podID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerID="dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51" exitCode=0
Oct 30 18:56:10.665426 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665421    6064 generic.go:356] "Generic (PLEG): container finished" podID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerID="0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63" exitCode=0
Oct 30 18:56:10.665577 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665462    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"
Oct 30 18:56:10.665577 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665483    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerDied","Data":"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"}
Oct 30 18:56:10.665577 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665544    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerDied","Data":"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"}
Oct 30 18:56:10.665577 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665566    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm" event={"ID":"e75f4dd5-98f1-4fc4-90bd-df5d2928b198","Type":"ContainerDied","Data":"f3ab40a329df62f4c0a713c0eb8d1202a8693fef1862e2404372d22f98b62f4b"}
Oct 30 18:56:10.665782 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.665589    6064 scope.go:122] "RemoveContainer" containerID="dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"
Oct 30 18:56:10.674188 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.674168    6064 scope.go:122] "RemoveContainer" containerID="0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"
Oct 30 18:56:10.681747 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.681731    6064 scope.go:122] "RemoveContainer" containerID="cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"
Oct 30 18:56:10.689039 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.689017    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"]
Oct 30 18:56:10.689877 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.689861    6064 scope.go:122] "RemoveContainer" containerID="dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"
Oct 30 18:56:10.690166 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:56:10.690148    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51\": container with ID starting with dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51 not found: ID does not exist" containerID="dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"
Oct 30 18:56:10.690240 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.690177    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"} err="failed to get container status \"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51\": rpc error: code = NotFound desc = could not find container \"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51\": container with ID starting with dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51 not found: ID does not exist"
Oct 30 18:56:10.690240 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.690194    6064 scope.go:122] "RemoveContainer" containerID="0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"
Oct 30 18:56:10.690444 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:56:10.690428    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63\": container with ID starting with 0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63 not found: ID does not exist" containerID="0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"
Oct 30 18:56:10.690488 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.690452    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"} err="failed to get container status \"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63\": rpc error: code = NotFound desc = could not find container \"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63\": container with ID starting with 0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63 not found: ID does not exist"
Oct 30 18:56:10.690488 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.690469    6064 scope.go:122] "RemoveContainer" containerID="cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"
Oct 30 18:56:10.690729 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:56:10.690703    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41\": container with ID starting with cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41 not found: ID does not exist" containerID="cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"
Oct 30 18:56:10.690814 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.690736    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"} err="failed to get container status \"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41\": rpc error: code = NotFound desc = could not find container \"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41\": container with ID starting with cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41 not found: ID does not exist"
Oct 30 18:56:10.690814 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.690753    6064 scope.go:122] "RemoveContainer" containerID="dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"
Oct 30 18:56:10.691034 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.691014    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51"} err="failed to get container status \"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51\": rpc error: code = NotFound desc = could not find container \"dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51\": container with ID starting with dd4afa98bea09b1fff287a2e09894b22ce403f485a80ccfcc89baaf8e9ef6d51 not found: ID does not exist"
Oct 30 18:56:10.691083 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.691035    6064 scope.go:122] "RemoveContainer" containerID="0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"
Oct 30 18:56:10.691255 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.691236    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63"} err="failed to get container status \"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63\": rpc error: code = NotFound desc = could not find container \"0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63\": container with ID starting with 0f69411bd29b71074de4d000cac269938173ebad40db6c31905f560c24d51d63 not found: ID does not exist"
Oct 30 18:56:10.691300 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.691256    6064 scope.go:122] "RemoveContainer" containerID="cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"
Oct 30 18:56:10.691480 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.691461    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41"} err="failed to get container status \"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41\": rpc error: code = NotFound desc = could not find container \"cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41\": container with ID starting with cb97598f0a6146fb12ed8b0a806adffe9576a65e1b03431c1c1125163ec2ce41 not found: ID does not exist"
Oct 30 18:56:10.694788 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:10.694734    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-lightgbm-predictor-b8947fc65-46rfm"]
Oct 30 18:56:11.167933 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.167894    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"]
Oct 30 18:56:11.168314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168219    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kserve-container"
Oct 30 18:56:11.168314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168231    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kserve-container"
Oct 30 18:56:11.168314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168242    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kube-rbac-proxy"
Oct 30 18:56:11.168314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168248    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kube-rbac-proxy"
Oct 30 18:56:11.168314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168255    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="storage-initializer"
Oct 30 18:56:11.168314 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168261    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="storage-initializer"
Oct 30 18:56:11.168502 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168324    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kserve-container"
Oct 30 18:56:11.168502 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.168330    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" containerName="kube-rbac-proxy"
Oct 30 18:56:11.176232 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.176206    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.181397 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.181372    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 18:56:11.181742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.181494    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 18:56:11.181742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.181552    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 18:56:11.181742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.181567    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 18:56:11.181905 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.181877    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-sklearn-v2-kube-rbac-proxy-sar-config\""
Oct 30 18:56:11.190035 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.190005    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"]
Oct 30 18:56:11.208510 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.208483    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.208600 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.208513    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.208600 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.208554    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5qjc\" (UniqueName: \"kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.208708 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.208645    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.208708 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.208700    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.237672 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.237631    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e75f4dd5-98f1-4fc4-90bd-df5d2928b198" path="/var/lib/kubelet/pods/e75f4dd5-98f1-4fc4-90bd-df5d2928b198/volumes"
Oct 30 18:56:11.283523 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.283497    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 18:56:11.283612 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.283582    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-predictive-sklearn-v2-predictor-serving-cert\""
Oct 30 18:56:11.309981 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.309958    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310062 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.309992    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310062 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.310039    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310062 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.310056    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310194 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.310081    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5qjc\" (UniqueName: \"kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310499 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.310481    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310721 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.310701    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.310789 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.310758    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.312782 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.312743    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.326488 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.326461    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5qjc\" (UniqueName: \"kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc\") pod \"isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") " pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.494320 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.494260    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:11.777638 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:11.777573    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"]
Oct 30 18:56:11.781288 ip-10-0-135-34 kubenswrapper[6064]: W1030 18:56:11.781263    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded8a452_11ed_4548_8022_94019e985ac9.slice/crio-a2f5e26136e9f11b8709917b8b03074e75a6757142bab138e047850956dc9953 WatchSource:0}: Error finding container a2f5e26136e9f11b8709917b8b03074e75a6757142bab138e047850956dc9953: Status 404 returned error can't find the container with id a2f5e26136e9f11b8709917b8b03074e75a6757142bab138e047850956dc9953
Oct 30 18:56:12.675226 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:12.675190    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerStarted","Data":"907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002"}
Oct 30 18:56:12.675726 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:12.675264    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerStarted","Data":"a2f5e26136e9f11b8709917b8b03074e75a6757142bab138e047850956dc9953"}
Oct 30 18:56:16.693200 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:16.693169    6064 generic.go:356] "Generic (PLEG): container finished" podID="ded8a452-11ed-4548-8022-94019e985ac9" containerID="907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002" exitCode=0
Oct 30 18:56:16.693605 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:16.693242    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerDied","Data":"907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002"}
Oct 30 18:56:17.701871 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:17.701833    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerStarted","Data":"1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471"}
Oct 30 18:56:17.702350 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:17.701912    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerStarted","Data":"f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9"}
Oct 30 18:56:17.702350 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:17.702153    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:17.725002 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:17.724954    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podStartSLOduration=2.665051972 podStartE2EDuration="6.724943675s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.059891703s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:56:17.723522643 +0000 UTC m=+1116.601795463" watchObservedRunningTime="2026-10-30 18:56:17.724943675 +0000 UTC m=+1116.603216472"
Oct 30 18:56:18.706301 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:18.706269    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:23.059583 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:56:23.059535    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:56:24.716948 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:24.716919    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:56:53.059029 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:56:53.058987    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:56:54.717742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:56:54.717706    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.30:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 18:57:04.717989 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:04.717948    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.30:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 18:57:14.717616 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:14.717580    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.30:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 18:57:23.061159 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:57:23.061078    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:57:25.196215 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:25.196178    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:57:31.526446 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:31.526417    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"]
Oct 30 18:57:31.526890 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:31.526694    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kube-rbac-proxy" containerID="cri-o://1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471" gracePeriod=30
Oct 30 18:57:31.526890 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:31.526694    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container" containerID="cri-o://f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9" gracePeriod=30
Oct 30 18:57:32.004169 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:32.004138    6064 generic.go:356] "Generic (PLEG): container finished" podID="ded8a452-11ed-4548-8022-94019e985ac9" containerID="1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471" exitCode=0
Oct 30 18:57:32.004319 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:32.004213    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerDied","Data":"1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471"}
Oct 30 18:57:34.712430 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:34.712390    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Oct 30 18:57:34.717408 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:34.717382    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.30:8080/v2/models/isvc-predictive-sklearn-v2/ready\": dial tcp 10.134.0.30:8080: connect: connection refused"
Oct 30 18:57:35.672282 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.672258    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:57:35.741924 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.741893    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config\") pod \"ded8a452-11ed-4548-8022-94019e985ac9\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") "
Oct 30 18:57:35.742322 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.741938    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls\") pod \"ded8a452-11ed-4548-8022-94019e985ac9\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") "
Oct 30 18:57:35.742322 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.741960    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc\" (UniqueName: \"kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc\") pod \"ded8a452-11ed-4548-8022-94019e985ac9\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") "
Oct 30 18:57:35.742322 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.742038    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert\") pod \"ded8a452-11ed-4548-8022-94019e985ac9\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") "
Oct 30 18:57:35.742322 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.742078    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location\") pod \"ded8a452-11ed-4548-8022-94019e985ac9\" (UID: \"ded8a452-11ed-4548-8022-94019e985ac9\") "
Oct 30 18:57:35.742488 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.742263    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config" pod "ded8a452-11ed-4548-8022-94019e985ac9" (UID: "ded8a452-11ed-4548-8022-94019e985ac9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:57:35.742488 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.742433    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert" pod "ded8a452-11ed-4548-8022-94019e985ac9" (UID: "ded8a452-11ed-4548-8022-94019e985ac9"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 18:57:35.742559 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.742486    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location" pod "ded8a452-11ed-4548-8022-94019e985ac9" (UID: "ded8a452-11ed-4548-8022-94019e985ac9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 18:57:35.744160 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.744140    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc" pod "ded8a452-11ed-4548-8022-94019e985ac9" (UID: "ded8a452-11ed-4548-8022-94019e985ac9"). InnerVolumeSpecName "kube-api-access-f5qjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 18:57:35.744229 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.744164    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls" pod "ded8a452-11ed-4548-8022-94019e985ac9" (UID: "ded8a452-11ed-4548-8022-94019e985ac9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 18:57:35.842581 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.842555    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:57:35.842581 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.842578    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ded8a452-11ed-4548-8022-94019e985ac9-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:57:35.842742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.842593    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ded8a452-11ed-4548-8022-94019e985ac9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:57:35.842742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.842607    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ded8a452-11ed-4548-8022-94019e985ac9-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:57:35.842742 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:35.842619    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5qjc\" (UniqueName: \"kubernetes.io/projected/ded8a452-11ed-4548-8022-94019e985ac9-kube-api-access-f5qjc\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 18:57:36.020830 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.020771    6064 generic.go:356] "Generic (PLEG): container finished" podID="ded8a452-11ed-4548-8022-94019e985ac9" containerID="f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9" exitCode=0
Oct 30 18:57:36.020933 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.020835    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"
Oct 30 18:57:36.020933 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.020892    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerDied","Data":"f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9"}
Oct 30 18:57:36.021047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.020958    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq" event={"ID":"ded8a452-11ed-4548-8022-94019e985ac9","Type":"ContainerDied","Data":"a2f5e26136e9f11b8709917b8b03074e75a6757142bab138e047850956dc9953"}
Oct 30 18:57:36.021047 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.021000    6064 scope.go:122] "RemoveContainer" containerID="1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471"
Oct 30 18:57:36.029360 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.029342    6064 scope.go:122] "RemoveContainer" containerID="f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9"
Oct 30 18:57:36.036625 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.036606    6064 scope.go:122] "RemoveContainer" containerID="907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002"
Oct 30 18:57:36.042969 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.042947    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"]
Oct 30 18:57:36.044567 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.044553    6064 scope.go:122] "RemoveContainer" containerID="1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471"
Oct 30 18:57:36.044837 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:57:36.044817    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471\": container with ID starting with 1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471 not found: ID does not exist" containerID="1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471"
Oct 30 18:57:36.044891 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.044851    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471"} err="failed to get container status \"1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471\": rpc error: code = NotFound desc = could not find container \"1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471\": container with ID starting with 1dbe668d28aa8e8cbd957e29acebb192307498f8cd851e491ca0288da1e1a471 not found: ID does not exist"
Oct 30 18:57:36.044891 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.044871    6064 scope.go:122] "RemoveContainer" containerID="f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9"
Oct 30 18:57:36.045100 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:57:36.045082    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9\": container with ID starting with f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9 not found: ID does not exist" containerID="f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9"
Oct 30 18:57:36.045158 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.045111    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9"} err="failed to get container status \"f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9\": rpc error: code = NotFound desc = could not find container \"f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9\": container with ID starting with f8c9198f1fe8d5c18f3692d994a1867d362049aa7f38c2e0bd18fb390a6a32a9 not found: ID does not exist"
Oct 30 18:57:36.045158 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.045133    6064 scope.go:122] "RemoveContainer" containerID="907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002"
Oct 30 18:57:36.045352 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:57:36.045337    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002\": container with ID starting with 907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002 not found: ID does not exist" containerID="907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002"
Oct 30 18:57:36.045404 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.045356    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002"} err="failed to get container status \"907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002\": rpc error: code = NotFound desc = could not find container \"907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002\": container with ID starting with 907a0af87ca765d767f04d90ed539ac0df6073b5481504babb0a99b36aa89002 not found: ID does not exist"
Oct 30 18:57:36.048831 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:36.048786    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-predictive-sklearn-v2-predictor-669f6464d5-8t6cq"]
Oct 30 18:57:37.237803 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:37.237766    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ded8a452-11ed-4548-8022-94019e985ac9" path="/var/lib/kubelet/pods/ded8a452-11ed-4548-8022-94019e985ac9/volumes"
Oct 30 18:57:41.360379 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:41.360348    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:57:41.364267 ip-10-0-135-34 kubenswrapper[6064]: I1030 18:57:41.364241    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 18:57:53.061097 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:57:53.061055    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:58:23.061896 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:58:23.061847    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:58:53.061589 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:58:53.061508    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:59:23.063376 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:59:23.063327    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 18:59:53.059684 ip-10-0-135-34 kubenswrapper[6064]: E1030 18:59:53.059631    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:00:21.783830 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.783710    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/curl-metrics-09f799df"]
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784137    6064 cpu_manager.go:414] "containerMap: removing container" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="storage-initializer"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784154    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="storage-initializer"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784191    6064 cpu_manager.go:414] "containerMap: removing container" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784200    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784221    6064 cpu_manager.go:414] "containerMap: removing container" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kube-rbac-proxy"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784229    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kube-rbac-proxy"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784309    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kserve-container"
Oct 30 19:00:21.784528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.784319    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="ded8a452-11ed-4548-8022-94019e985ac9" containerName="kube-rbac-proxy"
Oct 30 19:00:21.787342 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.787327    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:21.792054 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.792035    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Oct 30 19:00:21.792416 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.792401    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x652p\""
Oct 30 19:00:21.792505 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.792403    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Oct 30 19:00:21.796154 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.796138    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/curl-metrics-09f799df"]
Oct 30 19:00:21.858960 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.858935    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmkg\" (UniqueName: \"kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg\") pod \"curl-metrics-09f799df\" (UID: \"6deb25fb-2c9c-4330-aff9-172ec9c0911d\") " pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:21.960272 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.960233    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmkg\" (UniqueName: \"kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg\") pod \"curl-metrics-09f799df\" (UID: \"6deb25fb-2c9c-4330-aff9-172ec9c0911d\") " pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:21.972751 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:21.972727    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmkg\" (UniqueName: \"kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg\") pod \"curl-metrics-09f799df\" (UID: \"6deb25fb-2c9c-4330-aff9-172ec9c0911d\") " pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:22.107574 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:22.107550    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:22.384149 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:22.384072    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/curl-metrics-09f799df"]
Oct 30 19:00:22.387969 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:00:22.387941    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6deb25fb_2c9c_4330_aff9_172ec9c0911d.slice/crio-4cad32e2fdd75f2e7278b6cf2122eaf2aeea73b7633e377c597471adcc03a7b3 WatchSource:0}: Error finding container 4cad32e2fdd75f2e7278b6cf2122eaf2aeea73b7633e377c597471adcc03a7b3: Status 404 returned error can't find the container with id 4cad32e2fdd75f2e7278b6cf2122eaf2aeea73b7633e377c597471adcc03a7b3
Oct 30 19:00:22.389933 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:22.389907    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:00:22.680168 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:22.680106    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/curl-metrics-09f799df" event={"ID":"6deb25fb-2c9c-4330-aff9-172ec9c0911d","Type":"ContainerStarted","Data":"4cad32e2fdd75f2e7278b6cf2122eaf2aeea73b7633e377c597471adcc03a7b3"}
Oct 30 19:00:23.064366 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:00:23.064282    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:00:23.684791 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:23.684757    6064 generic.go:356] "Generic (PLEG): container finished" podID="6deb25fb-2c9c-4330-aff9-172ec9c0911d" containerID="095f6766d2923603c8c7fde78d8070a2e4019e62ce3a86caf5cec301b345817f" exitCode=0
Oct 30 19:00:23.684949 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:23.684847    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/curl-metrics-09f799df" event={"ID":"6deb25fb-2c9c-4330-aff9-172ec9c0911d","Type":"ContainerDied","Data":"095f6766d2923603c8c7fde78d8070a2e4019e62ce3a86caf5cec301b345817f"}
Oct 30 19:00:24.812142 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.812115    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:24.880416 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.880389    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg\" (UniqueName: \"kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg\") pod \"6deb25fb-2c9c-4330-aff9-172ec9c0911d\" (UID: \"6deb25fb-2c9c-4330-aff9-172ec9c0911d\") "
Oct 30 19:00:24.882547 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.882516    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg" pod "6deb25fb-2c9c-4330-aff9-172ec9c0911d" (UID: "6deb25fb-2c9c-4330-aff9-172ec9c0911d"). InnerVolumeSpecName "kube-api-access-2rmkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:00:24.884944 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.884925    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_curl-metrics-09f799df_6deb25fb-2c9c-4330-aff9-172ec9c0911d/curl-metrics-09f799df/0.log"
Oct 30 19:00:24.960489 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.960437    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/curl-metrics-09f799df"]
Oct 30 19:00:24.966046 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.966021    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/curl-metrics-09f799df"]
Oct 30 19:00:24.981704 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:24.981680    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rmkg\" (UniqueName: \"kubernetes.io/projected/6deb25fb-2c9c-4330-aff9-172ec9c0911d-kube-api-access-2rmkg\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:00:25.238111 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.238041    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6deb25fb-2c9c-4330-aff9-172ec9c0911d" path="/var/lib/kubelet/pods/6deb25fb-2c9c-4330-aff9-172ec9c0911d/volumes"
Oct 30 19:00:25.538813 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.538642    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/curl-metrics-b3284d98"]
Oct 30 19:00:25.539298 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.539278    6064 cpu_manager.go:414] "containerMap: removing container" podUID="6deb25fb-2c9c-4330-aff9-172ec9c0911d" containerName="curl-metrics-09f799df"
Oct 30 19:00:25.539387 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.539300    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6deb25fb-2c9c-4330-aff9-172ec9c0911d" containerName="curl-metrics-09f799df"
Oct 30 19:00:25.539387 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.539367    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="6deb25fb-2c9c-4330-aff9-172ec9c0911d" containerName="curl-metrics-09f799df"
Oct 30 19:00:25.542338 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.542323    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:25.549761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.549736    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/curl-metrics-b3284d98"]
Oct 30 19:00:25.585733 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.585703    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgxx\" (UniqueName: \"kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx\") pod \"curl-metrics-b3284d98\" (UID: \"d902a367-331a-44ff-b730-e13b32dd4f91\") " pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:25.686677 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.686626    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgxx\" (UniqueName: \"kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx\") pod \"curl-metrics-b3284d98\" (UID: \"d902a367-331a-44ff-b730-e13b32dd4f91\") " pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:25.694207 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.694190    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-09f799df"
Oct 30 19:00:25.694321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.694222    6064 scope.go:122] "RemoveContainer" containerID="095f6766d2923603c8c7fde78d8070a2e4019e62ce3a86caf5cec301b345817f"
Oct 30 19:00:25.698767 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.698745    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgxx\" (UniqueName: \"kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx\") pod \"curl-metrics-b3284d98\" (UID: \"d902a367-331a-44ff-b730-e13b32dd4f91\") " pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:25.864620 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:25.864596    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:26.147028 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:26.146965    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/curl-metrics-b3284d98"]
Oct 30 19:00:26.156141 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:00:26.156114    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd902a367_331a_44ff_b730_e13b32dd4f91.slice/crio-f4dadd5ffb4e7aa4fb59d8009092feffb3c5ff5e796412d338ca9d0f05e7d445 WatchSource:0}: Error finding container f4dadd5ffb4e7aa4fb59d8009092feffb3c5ff5e796412d338ca9d0f05e7d445: Status 404 returned error can't find the container with id f4dadd5ffb4e7aa4fb59d8009092feffb3c5ff5e796412d338ca9d0f05e7d445
Oct 30 19:00:26.700885 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:26.700853    6064 generic.go:356] "Generic (PLEG): container finished" podID="d902a367-331a-44ff-b730-e13b32dd4f91" containerID="7a5183771c089bbd05ffe6ba77199c66bfa914f44558183c2247e80e29f2c93e" exitCode=0
Oct 30 19:00:26.701035 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:26.700935    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/curl-metrics-b3284d98" event={"ID":"d902a367-331a-44ff-b730-e13b32dd4f91","Type":"ContainerDied","Data":"7a5183771c089bbd05ffe6ba77199c66bfa914f44558183c2247e80e29f2c93e"}
Oct 30 19:00:26.701035 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:26.700971    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/curl-metrics-b3284d98" event={"ID":"d902a367-331a-44ff-b730-e13b32dd4f91","Type":"ContainerStarted","Data":"f4dadd5ffb4e7aa4fb59d8009092feffb3c5ff5e796412d338ca9d0f05e7d445"}
Oct 30 19:00:27.821970 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:27.821946    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:27.855556 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:27.855530    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_curl-metrics-b3284d98_d902a367-331a-44ff-b730-e13b32dd4f91/curl-metrics-b3284d98/0.log"
Oct 30 19:00:27.905921 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:27.905894    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx\" (UniqueName: \"kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx\") pod \"d902a367-331a-44ff-b730-e13b32dd4f91\" (UID: \"d902a367-331a-44ff-b730-e13b32dd4f91\") "
Oct 30 19:00:27.907995 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:27.907963    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx" pod "d902a367-331a-44ff-b730-e13b32dd4f91" (UID: "d902a367-331a-44ff-b730-e13b32dd4f91"). InnerVolumeSpecName "kube-api-access-9bgxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:00:27.922454 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:27.922432    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/curl-metrics-b3284d98"]
Oct 30 19:00:27.929566 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:27.929517    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/curl-metrics-b3284d98"]
Oct 30 19:00:28.006733 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:28.006677    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bgxx\" (UniqueName: \"kubernetes.io/projected/d902a367-331a-44ff-b730-e13b32dd4f91-kube-api-access-9bgxx\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:00:28.710168 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:28.710140    6064 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4dadd5ffb4e7aa4fb59d8009092feffb3c5ff5e796412d338ca9d0f05e7d445"
Oct 30 19:00:28.710168 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:28.710152    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:28.720100 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:00:28.720067    6064 status_manager.go:1045] "Failed to get status for pod" err="pods \"curl-metrics-b3284d98\" is forbidden: User \"system:node:ip-10-0-135-34.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-135-34.us-east-2.compute.internal' and this object" podUID="d902a367-331a-44ff-b730-e13b32dd4f91" pod="kserve/curl-metrics-b3284d98"
Oct 30 19:00:29.242771 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:00:29.240224    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d902a367-331a-44ff-b730-e13b32dd4f91" path="/var/lib/kubelet/pods/d902a367-331a-44ff-b730-e13b32dd4f91/volumes"
Oct 30 19:00:53.061096 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:00:53.061052    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:01:23.059261 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:01:23.059222    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:01:53.064584 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:01:53.064506    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:02:23.063202 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:02:23.063156    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:02:41.386773 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:02:41.386739    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:02:41.392540 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:02:41.392520    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:02:53.062061 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:02:53.062022    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:03:23.061752 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:03:23.061647    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:03:53.060021 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:03:53.059981    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:04:23.061012 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:04:23.060971    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:04:53.060197 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:04:53.060121    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:05:23.059842 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:05:23.059794    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:05:53.060809 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:05:53.060765    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:06:04.716528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.716488    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"]
Oct 30 19:06:04.717200 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.717022    6064 cpu_manager.go:414] "containerMap: removing container" podUID="d902a367-331a-44ff-b730-e13b32dd4f91" containerName="curl-metrics-b3284d98"
Oct 30 19:06:04.717200 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.717041    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d902a367-331a-44ff-b730-e13b32dd4f91" containerName="curl-metrics-b3284d98"
Oct 30 19:06:04.717200 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.717119    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="d902a367-331a-44ff-b730-e13b32dd4f91" containerName="curl-metrics-b3284d98"
Oct 30 19:06:04.720272 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.720249    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.725568 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.725543    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-autogluon-v1-predictor-serving-cert\""
Oct 30 19:06:04.725782 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.725762    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:06:04.725855 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.725790    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:06:04.726366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.726350    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:06:04.726418 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.726352    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:06:04.726475 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.726460    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:06:04.726914 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.726767    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-autogluon-v1-kube-rbac-proxy-sar-config\""
Oct 30 19:06:04.735262 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.735239    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"]
Oct 30 19:06:04.883908 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.883880    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.884045 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.883915    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.884045 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.883942    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xmg\" (UniqueName: \"kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.884172 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.884083    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.884220 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.884185    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985232 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985147    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985385 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985236    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985385 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985279    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985503 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985423    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985503 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985471    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xmg\" (UniqueName: \"kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985850 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985818    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985972 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985906    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.985972 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.985918    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.987684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.987646    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:04.998018 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:04.997999    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xmg\" (UniqueName: \"kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg\") pod \"isvc-autogluon-v1-predictor-79d6b94b84-mcdmp\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") " pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:05.036714 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:05.036690    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:06:05.314580 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:05.314506    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"]
Oct 30 19:06:05.317817 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:06:05.317788    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176fe337_2493_4924_bec2_eacc3c0cdfb7.slice/crio-274c8ddf043758d55cfe90d1dc9881c2b2e6602177aba0cb842b8db2ec4c093f WatchSource:0}: Error finding container 274c8ddf043758d55cfe90d1dc9881c2b2e6602177aba0cb842b8db2ec4c093f: Status 404 returned error can't find the container with id 274c8ddf043758d55cfe90d1dc9881c2b2e6602177aba0cb842b8db2ec4c093f
Oct 30 19:06:06.013375 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:06.013339    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerStarted","Data":"667c79aaca518315dfd513ed17c5b4b655f16cb7a96aeb13b11d1bf4b121b3e5"}
Oct 30 19:06:06.013867 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:06.013394    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerStarted","Data":"274c8ddf043758d55cfe90d1dc9881c2b2e6602177aba0cb842b8db2ec4c093f"}
Oct 30 19:06:23.061717 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:06:23.061613    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:06:29.104756 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:29.104723    6064 generic.go:356] "Generic (PLEG): container finished" podID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerID="667c79aaca518315dfd513ed17c5b4b655f16cb7a96aeb13b11d1bf4b121b3e5" exitCode=0
Oct 30 19:06:29.105116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:29.104764    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerDied","Data":"667c79aaca518315dfd513ed17c5b4b655f16cb7a96aeb13b11d1bf4b121b3e5"}
Oct 30 19:06:29.106249 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:29.106232    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:06:41.425516 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:06:41.425487    6064 scope.go:122] "RemoveContainer" containerID="7a5183771c089bbd05ffe6ba77199c66bfa914f44558183c2247e80e29f2c93e"
Oct 30 19:06:53.067089 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:06:53.067047    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:07:23.060702 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:07:23.060638    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:07:41.417520 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:07:41.417493    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:07:41.424352 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:07:41.424329    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:07:53.065889 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:07:53.065792    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:08:21.598224 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:21.598189    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerStarted","Data":"30b67c0395f80f3b897d247b209489e506bc69bb105b7f669b64fc4ee5da8923"}
Oct 30 19:08:21.598629 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:21.598250    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerStarted","Data":"0331cfd91748d3dda39466214fc51565862b235eb9221fc9a7e2f067305f9ee2"}
Oct 30 19:08:21.598629 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:21.598320    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:08:21.620899 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:21.620694    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" podStartSLOduration=2.786739417 podStartE2EDuration="2m17.620679233s" totalImagesPullingTime="1m51.471796009s" totalInitContainerRuntime="23.362143807s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:08:21.619989946 +0000 UTC m=+1840.498262767" watchObservedRunningTime="2026-10-30 19:08:21.620679233 +0000 UTC m=+1840.498952054"
Oct 30 19:08:22.602229 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:22.602194    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:08:22.603265 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:22.603243    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Oct 30 19:08:23.060065 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:08:23.059979    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:08:23.606520 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:23.606462    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Oct 30 19:08:28.610761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:28.610725    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:08:28.611358 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:28.611251    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Oct 30 19:08:38.611799 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:38.611773    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:08:51.414383 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:51.414350    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"]
Oct 30 19:08:51.414909 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:51.414608    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container" containerID="cri-o://0331cfd91748d3dda39466214fc51565862b235eb9221fc9a7e2f067305f9ee2" gracePeriod=30
Oct 30 19:08:51.414909 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:51.414674    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kube-rbac-proxy" containerID="cri-o://30b67c0395f80f3b897d247b209489e506bc69bb105b7f669b64fc4ee5da8923" gracePeriod=30
Oct 30 19:08:51.719859 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:51.719772    6064 generic.go:356] "Generic (PLEG): container finished" podID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerID="30b67c0395f80f3b897d247b209489e506bc69bb105b7f669b64fc4ee5da8923" exitCode=0
Oct 30 19:08:51.719859 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:51.719824    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerDied","Data":"30b67c0395f80f3b897d247b209489e506bc69bb105b7f669b64fc4ee5da8923"}
Oct 30 19:08:52.726975 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.726927    6064 generic.go:356] "Generic (PLEG): container finished" podID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerID="0331cfd91748d3dda39466214fc51565862b235eb9221fc9a7e2f067305f9ee2" exitCode=0
Oct 30 19:08:52.726975 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.726975    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerDied","Data":"0331cfd91748d3dda39466214fc51565862b235eb9221fc9a7e2f067305f9ee2"}
Oct 30 19:08:52.785123 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.785102    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:08:52.822910 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.822844    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg\" (UniqueName: \"kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg\") pod \"176fe337-2493-4924-bec2-eacc3c0cdfb7\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") "
Oct 30 19:08:52.823032 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.822926    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location\") pod \"176fe337-2493-4924-bec2-eacc3c0cdfb7\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") "
Oct 30 19:08:52.823032 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.822948    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert\") pod \"176fe337-2493-4924-bec2-eacc3c0cdfb7\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") "
Oct 30 19:08:52.823032 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.822976    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config\") pod \"176fe337-2493-4924-bec2-eacc3c0cdfb7\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") "
Oct 30 19:08:52.823215 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.823122    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls\" (UniqueName: \"kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls\") pod \"176fe337-2493-4924-bec2-eacc3c0cdfb7\" (UID: \"176fe337-2493-4924-bec2-eacc3c0cdfb7\") "
Oct 30 19:08:52.823461 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.823301    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert" pod "176fe337-2493-4924-bec2-eacc3c0cdfb7" (UID: "176fe337-2493-4924-bec2-eacc3c0cdfb7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:08:52.823461 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.823308    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config" pod "176fe337-2493-4924-bec2-eacc3c0cdfb7" (UID: "176fe337-2493-4924-bec2-eacc3c0cdfb7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:08:52.823461 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.823416    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:52.823461 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.823437    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:52.825135 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.825106    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg" pod "176fe337-2493-4924-bec2-eacc3c0cdfb7" (UID: "176fe337-2493-4924-bec2-eacc3c0cdfb7"). InnerVolumeSpecName "kube-api-access-j6xmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:08:52.825135 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.825123    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls" pod "176fe337-2493-4924-bec2-eacc3c0cdfb7" (UID: "176fe337-2493-4924-bec2-eacc3c0cdfb7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:08:52.828108 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.828086    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location" pod "176fe337-2493-4924-bec2-eacc3c0cdfb7" (UID: "176fe337-2493-4924-bec2-eacc3c0cdfb7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:08:52.924695 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.924639    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6xmg\" (UniqueName: \"kubernetes.io/projected/176fe337-2493-4924-bec2-eacc3c0cdfb7-kube-api-access-j6xmg\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:52.924784 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.924703    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/176fe337-2493-4924-bec2-eacc3c0cdfb7-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:52.924784 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:52.924719    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/176fe337-2493-4924-bec2-eacc3c0cdfb7-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:08:53.059841 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:08:53.059812    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:08:53.732376 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.732347    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp" event={"ID":"176fe337-2493-4924-bec2-eacc3c0cdfb7","Type":"ContainerDied","Data":"274c8ddf043758d55cfe90d1dc9881c2b2e6602177aba0cb842b8db2ec4c093f"}
Oct 30 19:08:53.732844 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.732417    6064 scope.go:122] "RemoveContainer" containerID="30b67c0395f80f3b897d247b209489e506bc69bb105b7f669b64fc4ee5da8923"
Oct 30 19:08:53.732844 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.732358    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"
Oct 30 19:08:53.740943 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.740926    6064 scope.go:122] "RemoveContainer" containerID="0331cfd91748d3dda39466214fc51565862b235eb9221fc9a7e2f067305f9ee2"
Oct 30 19:08:53.748337 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.748318    6064 scope.go:122] "RemoveContainer" containerID="667c79aaca518315dfd513ed17c5b4b655f16cb7a96aeb13b11d1bf4b121b3e5"
Oct 30 19:08:53.748515 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.748492    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"]
Oct 30 19:08:53.753685 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:53.753638    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-autogluon-v1-predictor-79d6b94b84-mcdmp"]
Oct 30 19:08:55.237375 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:08:55.237333    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" path="/var/lib/kubelet/pods/176fe337-2493-4924-bec2-eacc3c0cdfb7/volumes"
Oct 30 19:09:23.063289 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:09:23.063200    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:09:53.060716 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:09:53.060647    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:10:23.059776 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:10:23.059739    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:10:53.059165 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:10:53.059086    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:11:23.058961 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:11:23.058912    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:11:36.736129 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.736096    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"]
Oct 30 19:11:36.737049 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737025    6064 cpu_manager.go:414] "containerMap: removing container" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="storage-initializer"
Oct 30 19:11:36.737049 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737048    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="storage-initializer"
Oct 30 19:11:36.737184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737059    6064 cpu_manager.go:414] "containerMap: removing container" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container"
Oct 30 19:11:36.737184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737064    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container"
Oct 30 19:11:36.737184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737080    6064 cpu_manager.go:414] "containerMap: removing container" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kube-rbac-proxy"
Oct 30 19:11:36.737184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737084    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kube-rbac-proxy"
Oct 30 19:11:36.737184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737148    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kserve-container"
Oct 30 19:11:36.737184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.737156    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="176fe337-2493-4924-bec2-eacc3c0cdfb7" containerName="kube-rbac-proxy"
Oct 30 19:11:36.740296 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.740278    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.752158 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752138    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 19:11:36.752158 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752141    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:11:36.752302 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752199    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-tensorflow-kube-rbac-proxy-sar-config\""
Oct 30 19:11:36.752302 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752174    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:11:36.752302 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752254    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:11:36.752425 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752360    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:11:36.752509 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.752488    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-tensorflow-predictor-serving-cert\""
Oct 30 19:11:36.758835 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.758809    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"]
Oct 30 19:11:36.898494 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.898461    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.898600 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.898506    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.898648 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.898615    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.898725 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.898672    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.898725 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.898721    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhd8g\" (UniqueName: \"kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999270 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999213    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999270 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999251    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999270 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999267    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhd8g\" (UniqueName: \"kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999395    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999440    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999846 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999823    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999901 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999865    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:36.999991 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:36.999973    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:37.002010 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:37.001992    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:37.023329 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:37.023302    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhd8g\" (UniqueName: \"kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g\") pod \"isvc-tensorflow-predictor-6d68bf4945-wrdgp\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:37.057602 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:37.057582    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:37.336476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:37.336447    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"]
Oct 30 19:11:37.339575 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:11:37.339548    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eabed74_4697_4452_8a1a_823f54b4febd.slice/crio-e82b484a9af503fe9ec408cd84ad8b23e8064a89cf7056f66579b46fac1a0791 WatchSource:0}: Error finding container e82b484a9af503fe9ec408cd84ad8b23e8064a89cf7056f66579b46fac1a0791: Status 404 returned error can't find the container with id e82b484a9af503fe9ec408cd84ad8b23e8064a89cf7056f66579b46fac1a0791
Oct 30 19:11:37.362627 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:37.362602    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerStarted","Data":"e82b484a9af503fe9ec408cd84ad8b23e8064a89cf7056f66579b46fac1a0791"}
Oct 30 19:11:38.369126 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:38.369084    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerStarted","Data":"2bb19af8c4bea89706818766eacb03b4113b25d04ab2f5a3f7c136a092f4c091"}
Oct 30 19:11:43.389013 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:43.388982    6064 generic.go:356] "Generic (PLEG): container finished" podID="7eabed74-4697-4452-8a1a-823f54b4febd" containerID="2bb19af8c4bea89706818766eacb03b4113b25d04ab2f5a3f7c136a092f4c091" exitCode=0
Oct 30 19:11:43.389510 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:43.389054    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerDied","Data":"2bb19af8c4bea89706818766eacb03b4113b25d04ab2f5a3f7c136a092f4c091"}
Oct 30 19:11:43.390253 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:43.390238    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:11:47.410793 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:47.410758    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerStarted","Data":"7c5fd319df25c7b16bfc2b72d692e88f4ec45ee61cb85138f5db9610e300eb83"}
Oct 30 19:11:47.411181 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:47.410822    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerStarted","Data":"61ac9de0c7430da3e794e4c75524c11dee1c5b7763be61665a539b86c416b71b"}
Oct 30 19:11:47.411181 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:47.411009    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:47.434170 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:47.434121    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podStartSLOduration=2.339286251 podStartE2EDuration="11.434111018s" totalImagesPullingTime="3.665992965s" totalInitContainerRuntime="5.428831802s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:11:47.433889455 +0000 UTC m=+2046.312162277" watchObservedRunningTime="2026-10-30 19:11:47.434111018 +0000 UTC m=+2046.312383832"
Oct 30 19:11:48.414562 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:48.414531    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:48.415737 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:48.415711    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Oct 30 19:11:49.418115 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:49.418072    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Oct 30 19:11:53.059828 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:11:53.059791    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:11:54.422480 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:54.422447    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:11:54.422938 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:11:54.422915    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Oct 30 19:12:04.423633 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:04.423598    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:12:16.389684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:16.389611    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"]
Oct 30 19:12:16.390095 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:16.389944    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container" containerID="cri-o://61ac9de0c7430da3e794e4c75524c11dee1c5b7763be61665a539b86c416b71b" gracePeriod=30
Oct 30 19:12:16.390095 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:16.389993    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" containerID="cri-o://7c5fd319df25c7b16bfc2b72d692e88f4ec45ee61cb85138f5db9610e300eb83" gracePeriod=30
Oct 30 19:12:16.527832 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:16.527804    6064 generic.go:356] "Generic (PLEG): container finished" podID="7eabed74-4697-4452-8a1a-823f54b4febd" containerID="7c5fd319df25c7b16bfc2b72d692e88f4ec45ee61cb85138f5db9610e300eb83" exitCode=0
Oct 30 19:12:16.527939 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:16.527866    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerDied","Data":"7c5fd319df25c7b16bfc2b72d692e88f4ec45ee61cb85138f5db9610e300eb83"}
Oct 30 19:12:19.419181 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:19.419139    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Oct 30 19:12:23.059606 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:12:23.059524    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:12:24.418962 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:24.418910    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Oct 30 19:12:29.418289 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:29.418250    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Oct 30 19:12:29.418770 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:29.418361    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:12:34.419017 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:34.418965    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Oct 30 19:12:39.419048 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:39.419008    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Oct 30 19:12:41.449401 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:41.449371    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:12:41.456710 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:41.456689    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:12:44.418613 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:44.418565    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Oct 30 19:12:46.650053 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:46.649973    6064 generic.go:356] "Generic (PLEG): container finished" podID="7eabed74-4697-4452-8a1a-823f54b4febd" containerID="61ac9de0c7430da3e794e4c75524c11dee1c5b7763be61665a539b86c416b71b" exitCode=137
Oct 30 19:12:46.650356 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:46.650052    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerDied","Data":"61ac9de0c7430da3e794e4c75524c11dee1c5b7763be61665a539b86c416b71b"}
Oct 30 19:12:47.032065 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.032042    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:12:47.132562 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132533    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert\") pod \"7eabed74-4697-4452-8a1a-823f54b4febd\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") "
Oct 30 19:12:47.132713 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132569    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config\") pod \"7eabed74-4697-4452-8a1a-823f54b4febd\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") "
Oct 30 19:12:47.132713 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132592    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location\") pod \"7eabed74-4697-4452-8a1a-823f54b4febd\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") "
Oct 30 19:12:47.132713 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132691    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls\") pod \"7eabed74-4697-4452-8a1a-823f54b4febd\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") "
Oct 30 19:12:47.132871 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132746    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g\" (UniqueName: \"kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g\") pod \"7eabed74-4697-4452-8a1a-823f54b4febd\" (UID: \"7eabed74-4697-4452-8a1a-823f54b4febd\") "
Oct 30 19:12:47.132955 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132928    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert" pod "7eabed74-4697-4452-8a1a-823f54b4febd" (UID: "7eabed74-4697-4452-8a1a-823f54b4febd"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:12:47.133078 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.132965    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config" pod "7eabed74-4697-4452-8a1a-823f54b4febd" (UID: "7eabed74-4697-4452-8a1a-823f54b4febd"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:12:47.133078 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.133038    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:12:47.134915 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.134892    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls" pod "7eabed74-4697-4452-8a1a-823f54b4febd" (UID: "7eabed74-4697-4452-8a1a-823f54b4febd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:12:47.135022 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.134962    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g" pod "7eabed74-4697-4452-8a1a-823f54b4febd" (UID: "7eabed74-4697-4452-8a1a-823f54b4febd"). InnerVolumeSpecName "kube-api-access-zhd8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:12:47.143515 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.143471    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location" pod "7eabed74-4697-4452-8a1a-823f54b4febd" (UID: "7eabed74-4697-4452-8a1a-823f54b4febd"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:12:47.234369 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.234308    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eabed74-4697-4452-8a1a-823f54b4febd-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:12:47.234369 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.234330    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eabed74-4697-4452-8a1a-823f54b4febd-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:12:47.234369 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.234340    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eabed74-4697-4452-8a1a-823f54b4febd-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:12:47.234369 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.234350    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhd8g\" (UniqueName: \"kubernetes.io/projected/7eabed74-4697-4452-8a1a-823f54b4febd-kube-api-access-zhd8g\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:12:47.655839 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.655808    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"
Oct 30 19:12:47.656273 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.655839    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp" event={"ID":"7eabed74-4697-4452-8a1a-823f54b4febd","Type":"ContainerDied","Data":"e82b484a9af503fe9ec408cd84ad8b23e8064a89cf7056f66579b46fac1a0791"}
Oct 30 19:12:47.656273 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.655922    6064 scope.go:122] "RemoveContainer" containerID="7c5fd319df25c7b16bfc2b72d692e88f4ec45ee61cb85138f5db9610e300eb83"
Oct 30 19:12:47.664705 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.664684    6064 scope.go:122] "RemoveContainer" containerID="61ac9de0c7430da3e794e4c75524c11dee1c5b7763be61665a539b86c416b71b"
Oct 30 19:12:47.671975 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.671957    6064 scope.go:122] "RemoveContainer" containerID="2bb19af8c4bea89706818766eacb03b4113b25d04ab2f5a3f7c136a092f4c091"
Oct 30 19:12:47.673361 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.673338    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"]
Oct 30 19:12:47.680648 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:47.680621    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-predictor-6d68bf4945-wrdgp"]
Oct 30 19:12:48.180878 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.180840    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"]
Oct 30 19:12:48.181278 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181260    6064 cpu_manager.go:414] "containerMap: removing container" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container"
Oct 30 19:12:48.181337 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181282    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container"
Oct 30 19:12:48.181337 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181296    6064 cpu_manager.go:414] "containerMap: removing container" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="storage-initializer"
Oct 30 19:12:48.181337 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181301    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="storage-initializer"
Oct 30 19:12:48.181337 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181310    6064 cpu_manager.go:414] "containerMap: removing container" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy"
Oct 30 19:12:48.181337 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181315    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy"
Oct 30 19:12:48.181488 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181373    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kserve-container"
Oct 30 19:12:48.181488 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.181382    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" containerName="kube-rbac-proxy"
Oct 30 19:12:48.186242 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.186220    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.198033 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198012    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 19:12:48.198311 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198290    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:12:48.198385 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198370    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:12:48.198442 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198385    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:12:48.198676 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198636    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-tensorflow-runtime-predictor-serving-cert\""
Oct 30 19:12:48.198676 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198644    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:12:48.198772 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.198671    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-tensorflow-runtime-kube-rbac-proxy-sar-config\""
Oct 30 19:12:48.205111 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.205091    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"]
Oct 30 19:12:48.242302 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.242275    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.242409 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.242304    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.242409 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.242329    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.242409 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.242352    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.242547 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.242505    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lg64\" (UniqueName: \"kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.343676 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.343625    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.343804 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.343690    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.343804 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.343730    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.343804 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.343766    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.343962 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.343840    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lg64\" (UniqueName: \"kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.344155 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.344134    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.344447 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.344429    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.344499 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.344446    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.346339 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.346317    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.358250 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.358227    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lg64\" (UniqueName: \"kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64\") pod \"isvc-tensorflow-runtime-predictor-d7896bb89-cshv8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") " pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.504063 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.503974    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:48.782327 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:48.782231    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"]
Oct 30 19:12:48.785872 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:12:48.785844    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63a3c09_dcef_464f_a9f8_1de98db99cb8.slice/crio-e59cc0f9113174d13a5f61e1b21c33640177745915b33d93c52dbedbc881268b WatchSource:0}: Error finding container e59cc0f9113174d13a5f61e1b21c33640177745915b33d93c52dbedbc881268b: Status 404 returned error can't find the container with id e59cc0f9113174d13a5f61e1b21c33640177745915b33d93c52dbedbc881268b
Oct 30 19:12:49.239017 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:49.238972    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7eabed74-4697-4452-8a1a-823f54b4febd" path="/var/lib/kubelet/pods/7eabed74-4697-4452-8a1a-823f54b4febd/volumes"
Oct 30 19:12:49.666780 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:49.666745    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerStarted","Data":"a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813"}
Oct 30 19:12:49.666945 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:49.666811    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerStarted","Data":"e59cc0f9113174d13a5f61e1b21c33640177745915b33d93c52dbedbc881268b"}
Oct 30 19:12:53.060702 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:12:53.060641    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:12:54.687098 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:54.687064    6064 generic.go:356] "Generic (PLEG): container finished" podID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerID="a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813" exitCode=0
Oct 30 19:12:54.687569 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:54.687152    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerDied","Data":"a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813"}
Oct 30 19:12:55.696591 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:55.696554    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerStarted","Data":"b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa"}
Oct 30 19:12:55.697058 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:55.696620    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerStarted","Data":"a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf"}
Oct 30 19:12:55.697058 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:55.696924    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:55.697058 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:55.696985    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:12:55.698108 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:55.698077    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Oct 30 19:12:55.719626 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:55.719575    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podStartSLOduration=2.70982269 podStartE2EDuration="7.719559606s" totalImagesPullingTime="0s" totalInitContainerRuntime="5.009736916s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:12:55.71818426 +0000 UTC m=+2114.596457083" watchObservedRunningTime="2026-10-30 19:12:55.719559606 +0000 UTC m=+2114.597832426"
Oct 30 19:12:56.701791 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:12:56.701755    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Oct 30 19:13:01.706955 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:01.706929    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:13:01.707452 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:01.707425    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Oct 30 19:13:11.707532 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:11.707504    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:13:23.065846 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:13:23.065807    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:13:28.092148 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:28.092112    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"]
Oct 30 19:13:28.092763 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:28.092320    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container" containerID="cri-o://a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf" gracePeriod=30
Oct 30 19:13:28.092763 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:28.092375    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" containerID="cri-o://b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa" gracePeriod=30
Oct 30 19:13:28.828612 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:28.828583    6064 generic.go:356] "Generic (PLEG): container finished" podID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerID="b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa" exitCode=0
Oct 30 19:13:28.828792 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:28.828643    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerDied","Data":"b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa"}
Oct 30 19:13:31.702644 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:31.702599    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Oct 30 19:13:36.702720 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:36.702679    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Oct 30 19:13:41.702329 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:41.702291    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Oct 30 19:13:41.702681 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:41.702426    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:13:46.702774 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:46.702728    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Oct 30 19:13:51.702692 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:51.702594    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Oct 30 19:13:53.059914 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:13:53.059878    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:13:56.702612 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:56.702574    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Oct 30 19:13:58.739995 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.739970    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:13:58.869738 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.869680    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64\" (UniqueName: \"kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64\") pod \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") "
Oct 30 19:13:58.869738 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.869724    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location\") pod \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") "
Oct 30 19:13:58.869885 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.869752    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config\") pod \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") "
Oct 30 19:13:58.869885 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.869788    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert\") pod \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") "
Oct 30 19:13:58.869885 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.869813    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls\") pod \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\" (UID: \"f63a3c09-dcef-464f-a9f8-1de98db99cb8\") "
Oct 30 19:13:58.870175 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.870147    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config" pod "f63a3c09-dcef-464f-a9f8-1de98db99cb8" (UID: "f63a3c09-dcef-464f-a9f8-1de98db99cb8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:13:58.870175 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.870159    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert" pod "f63a3c09-dcef-464f-a9f8-1de98db99cb8" (UID: "f63a3c09-dcef-464f-a9f8-1de98db99cb8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:13:58.871957 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.871934    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64" pod "f63a3c09-dcef-464f-a9f8-1de98db99cb8" (UID: "f63a3c09-dcef-464f-a9f8-1de98db99cb8"). InnerVolumeSpecName "kube-api-access-7lg64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:13:58.872080 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.872057    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls" pod "f63a3c09-dcef-464f-a9f8-1de98db99cb8" (UID: "f63a3c09-dcef-464f-a9f8-1de98db99cb8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:13:58.880856 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.880833    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location" pod "f63a3c09-dcef-464f-a9f8-1de98db99cb8" (UID: "f63a3c09-dcef-464f-a9f8-1de98db99cb8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:13:58.952450 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.952424    6064 generic.go:356] "Generic (PLEG): container finished" podID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerID="a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf" exitCode=137
Oct 30 19:13:58.952556 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.952471    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerDied","Data":"a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf"}
Oct 30 19:13:58.952556 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.952489    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"
Oct 30 19:13:58.952556 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.952541    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8" event={"ID":"f63a3c09-dcef-464f-a9f8-1de98db99cb8","Type":"ContainerDied","Data":"e59cc0f9113174d13a5f61e1b21c33640177745915b33d93c52dbedbc881268b"}
Oct 30 19:13:58.952684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.952581    6064 scope.go:122] "RemoveContainer" containerID="b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa"
Oct 30 19:13:58.961666 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.961632    6064 scope.go:122] "RemoveContainer" containerID="a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf"
Oct 30 19:13:58.968953 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.968933    6064 scope.go:122] "RemoveContainer" containerID="a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813"
Oct 30 19:13:58.971079 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.971060    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:13:58.971152 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.971081    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f63a3c09-dcef-464f-a9f8-1de98db99cb8-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:13:58.971152 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.971091    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lg64\" (UniqueName: \"kubernetes.io/projected/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-api-access-7lg64\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:13:58.971152 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.971100    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:13:58.971152 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.971109    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f63a3c09-dcef-464f-a9f8-1de98db99cb8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:13:58.976070 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.976039    6064 scope.go:122] "RemoveContainer" containerID="b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa"
Oct 30 19:13:58.976366 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:13:58.976339    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa\": container with ID starting with b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa not found: ID does not exist" containerID="b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa"
Oct 30 19:13:58.976366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.976376    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa"} err="failed to get container status \"b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa\": rpc error: code = NotFound desc = could not find container \"b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa\": container with ID starting with b030ad3ff364ca7f7c65fc1a1ca5046bf1c12cd806870a41bfdea451383b6daa not found: ID does not exist"
Oct 30 19:13:58.976366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.976397    6064 scope.go:122] "RemoveContainer" containerID="a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf"
Oct 30 19:13:58.976862 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.976846    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"]
Oct 30 19:13:58.977143 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:13:58.977122    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf\": container with ID starting with a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf not found: ID does not exist" containerID="a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf"
Oct 30 19:13:58.977190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.977148    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf"} err="failed to get container status \"a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf\": rpc error: code = NotFound desc = could not find container \"a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf\": container with ID starting with a63594a88c0df3b03955103891510a0d783d4d83b8e166d8aab1b95470481daf not found: ID does not exist"
Oct 30 19:13:58.977190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.977164    6064 scope.go:122] "RemoveContainer" containerID="a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813"
Oct 30 19:13:58.977408 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:13:58.977390    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813\": container with ID starting with a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813 not found: ID does not exist" containerID="a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813"
Oct 30 19:13:58.977455 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.977412    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813"} err="failed to get container status \"a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813\": rpc error: code = NotFound desc = could not find container \"a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813\": container with ID starting with a9bbffd42fb95d5c7319ac447c3146b2d5b4a02f0988a8387b8f9301d020c813 not found: ID does not exist"
Oct 30 19:13:58.980883 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:58.980864    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-tensorflow-runtime-predictor-d7896bb89-cshv8"]
Oct 30 19:13:59.238081 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:13:59.238007    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" path="/var/lib/kubelet/pods/f63a3c09-dcef-464f-a9f8-1de98db99cb8/volumes"
Oct 30 19:14:00.053276 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.053237    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"]
Oct 30 19:14:00.054056 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054023    6064 cpu_manager.go:414] "containerMap: removing container" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container"
Oct 30 19:14:00.054056 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054051    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container"
Oct 30 19:14:00.054203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054071    6064 cpu_manager.go:414] "containerMap: removing container" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="storage-initializer"
Oct 30 19:14:00.054203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054076    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="storage-initializer"
Oct 30 19:14:00.054203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054083    6064 cpu_manager.go:414] "containerMap: removing container" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy"
Oct 30 19:14:00.054203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054087    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy"
Oct 30 19:14:00.054203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054144    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kserve-container"
Oct 30 19:14:00.054203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.054153    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="f63a3c09-dcef-464f-a9f8-1de98db99cb8" containerName="kube-rbac-proxy"
Oct 30 19:14:00.057304 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.057290    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.061910 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.061889    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 19:14:00.061910 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.061907    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-triton-predictor-serving-cert\""
Oct 30 19:14:00.062083 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.061898    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:14:00.062083 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.061890    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-triton-kube-rbac-proxy-sar-config\""
Oct 30 19:14:00.062083 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.061961    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:14:00.062083 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.062011    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:14:00.062379 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.062367    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:14:00.069034 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.069011    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"]
Oct 30 19:14:00.181442 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.181416    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.181565 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.181447    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc4g7\" (UniqueName: \"kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.181565 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.181482    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.181734 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.181713    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.181801 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.181767    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.282971 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.282946    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283072 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.282980    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283072 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.283017    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283072 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.283052    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc4g7\" (UniqueName: \"kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283225 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.283104    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283493 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.283473    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283815 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.283794    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.283870 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.283794    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.285537 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.285519    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.295303 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.295279    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc4g7\" (UniqueName: \"kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7\") pod \"isvc-triton-predictor-6fcbd458f8-7khl6\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") " pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.374231 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.374203    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:14:00.654464 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.654399    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"]
Oct 30 19:14:00.657872 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:14:00.657846    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0907a64_8c2d_4523_b1be_e23e09813466.slice/crio-67efe454c48f6eaa4b1745a5283bbb34dac8828b55112f2c7208baa1de9be0f9 WatchSource:0}: Error finding container 67efe454c48f6eaa4b1745a5283bbb34dac8828b55112f2c7208baa1de9be0f9: Status 404 returned error can't find the container with id 67efe454c48f6eaa4b1745a5283bbb34dac8828b55112f2c7208baa1de9be0f9
Oct 30 19:14:00.964813 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.964725    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerStarted","Data":"74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162"}
Oct 30 19:14:00.964813 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:00.964780    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerStarted","Data":"67efe454c48f6eaa4b1745a5283bbb34dac8828b55112f2c7208baa1de9be0f9"}
Oct 30 19:14:04.982971 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:04.982936    6064 generic.go:356] "Generic (PLEG): container finished" podID="a0907a64-8c2d-4523-b1be-e23e09813466" containerID="74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162" exitCode=0
Oct 30 19:14:04.983310 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:14:04.983016    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerDied","Data":"74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162"}
Oct 30 19:14:23.071588 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:14:23.071543    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:14:53.063241 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:14:53.063195    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:15:23.122034 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:15:23.121946    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:15:53.062851 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:15:53.062813    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:16:02.552280 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:02.552252    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerStarted","Data":"ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9"}
Oct 30 19:16:03.557859 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:03.557823    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerStarted","Data":"e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb"}
Oct 30 19:16:03.558242 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:03.557887    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:16:03.558242 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:03.557932    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:16:03.559046 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:03.559021    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Oct 30 19:16:03.581151 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:03.581095    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" podStartSLOduration=1.986432646 podStartE2EDuration="2m3.581083507s" totalImagesPullingTime="1m57.396978177s" totalInitContainerRuntime="4.197672684s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:16:03.580331633 +0000 UTC m=+2302.458604453" watchObservedRunningTime="2026-10-30 19:16:03.581083507 +0000 UTC m=+2302.459356320"
Oct 30 19:16:04.562314 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:04.562267    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Oct 30 19:16:09.566499 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:09.566460    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:16:09.567390 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:09.567368    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:16:12.931938 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:12.931911    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"]
Oct 30 19:16:12.932347 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:12.932124    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kserve-container" containerID="cri-o://ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9" gracePeriod=30
Oct 30 19:16:12.932347 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:12.932147    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kube-rbac-proxy" containerID="cri-o://e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb" gracePeriod=30
Oct 30 19:16:13.597456 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:13.597422    6064 generic.go:356] "Generic (PLEG): container finished" podID="a0907a64-8c2d-4523-b1be-e23e09813466" containerID="e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb" exitCode=0
Oct 30 19:16:13.597619 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:13.597490    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerDied","Data":"e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb"}
Oct 30 19:16:14.562712 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:14.562647    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Oct 30 19:16:15.113873 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.113849    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:16:15.304947 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.304885    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7\" (UniqueName: \"kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7\") pod \"a0907a64-8c2d-4523-b1be-e23e09813466\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") "
Oct 30 19:16:15.304947 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.304918    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location\") pod \"a0907a64-8c2d-4523-b1be-e23e09813466\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") "
Oct 30 19:16:15.305226 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.304948    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls\" (UniqueName: \"kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls\") pod \"a0907a64-8c2d-4523-b1be-e23e09813466\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") "
Oct 30 19:16:15.305226 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.305005    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert\") pod \"a0907a64-8c2d-4523-b1be-e23e09813466\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") "
Oct 30 19:16:15.305226 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.305022    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config\") pod \"a0907a64-8c2d-4523-b1be-e23e09813466\" (UID: \"a0907a64-8c2d-4523-b1be-e23e09813466\") "
Oct 30 19:16:15.305452 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.305421    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert" pod "a0907a64-8c2d-4523-b1be-e23e09813466" (UID: "a0907a64-8c2d-4523-b1be-e23e09813466"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:16:15.305506 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.305444    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location" pod "a0907a64-8c2d-4523-b1be-e23e09813466" (UID: "a0907a64-8c2d-4523-b1be-e23e09813466"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:16:15.305506 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.305485    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config" pod "a0907a64-8c2d-4523-b1be-e23e09813466" (UID: "a0907a64-8c2d-4523-b1be-e23e09813466"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:16:15.311067 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.311030    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls" pod "a0907a64-8c2d-4523-b1be-e23e09813466" (UID: "a0907a64-8c2d-4523-b1be-e23e09813466"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:16:15.311161 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.311090    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7" pod "a0907a64-8c2d-4523-b1be-e23e09813466" (UID: "a0907a64-8c2d-4523-b1be-e23e09813466"). InnerVolumeSpecName "kube-api-access-xc4g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:16:15.405610 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.405584    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc4g7\" (UniqueName: \"kubernetes.io/projected/a0907a64-8c2d-4523-b1be-e23e09813466-kube-api-access-xc4g7\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:16:15.405610 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.405608    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0907a64-8c2d-4523-b1be-e23e09813466-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:16:15.405787 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.405619    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a0907a64-8c2d-4523-b1be-e23e09813466-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:16:15.405787 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.405629    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:16:15.405787 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.405638    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a0907a64-8c2d-4523-b1be-e23e09813466-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:16:15.606797 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.606770    6064 generic.go:356] "Generic (PLEG): container finished" podID="a0907a64-8c2d-4523-b1be-e23e09813466" containerID="ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9" exitCode=0
Oct 30 19:16:15.607218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.606826    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"
Oct 30 19:16:15.607218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.606851    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerDied","Data":"ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9"}
Oct 30 19:16:15.607218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.606917    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6" event={"ID":"a0907a64-8c2d-4523-b1be-e23e09813466","Type":"ContainerDied","Data":"67efe454c48f6eaa4b1745a5283bbb34dac8828b55112f2c7208baa1de9be0f9"}
Oct 30 19:16:15.607218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.606954    6064 scope.go:122] "RemoveContainer" containerID="e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb"
Oct 30 19:16:15.615608 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.615588    6064 scope.go:122] "RemoveContainer" containerID="ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9"
Oct 30 19:16:15.623500 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.623484    6064 scope.go:122] "RemoveContainer" containerID="74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162"
Oct 30 19:16:15.629247 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.629226    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"]
Oct 30 19:16:15.630908 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.630890    6064 scope.go:122] "RemoveContainer" containerID="e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb"
Oct 30 19:16:15.631171 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:16:15.631152    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb\": container with ID starting with e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb not found: ID does not exist" containerID="e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb"
Oct 30 19:16:15.631234 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.631180    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb"} err="failed to get container status \"e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb\": rpc error: code = NotFound desc = could not find container \"e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb\": container with ID starting with e7c93c7d5b325a1eb78820a9d7d5ee470f3171db78ec43436c0112a7650448bb not found: ID does not exist"
Oct 30 19:16:15.631234 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.631199    6064 scope.go:122] "RemoveContainer" containerID="ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9"
Oct 30 19:16:15.631418 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:16:15.631402    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9\": container with ID starting with ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9 not found: ID does not exist" containerID="ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9"
Oct 30 19:16:15.631456 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.631423    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9"} err="failed to get container status \"ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9\": rpc error: code = NotFound desc = could not find container \"ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9\": container with ID starting with ccf6692143058dd5f95cbe81342d3c0287b9b1107fd2d61302bbf6e81dfe3db9 not found: ID does not exist"
Oct 30 19:16:15.631456 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.631436    6064 scope.go:122] "RemoveContainer" containerID="74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162"
Oct 30 19:16:15.631766 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:16:15.631746    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162\": container with ID starting with 74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162 not found: ID does not exist" containerID="74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162"
Oct 30 19:16:15.631839 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.631775    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162"} err="failed to get container status \"74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162\": rpc error: code = NotFound desc = could not find container \"74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162\": container with ID starting with 74e7010412d33359bcb5494153e98c331c8d59dd1c6517ba06600efea4ebc162 not found: ID does not exist"
Oct 30 19:16:15.633632 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:15.633612    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-triton-predictor-6fcbd458f8-7khl6"]
Oct 30 19:16:16.273139 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273107    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"]
Oct 30 19:16:16.273613 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273585    6064 cpu_manager.go:414] "containerMap: removing container" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kube-rbac-proxy"
Oct 30 19:16:16.273613 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273607    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kube-rbac-proxy"
Oct 30 19:16:16.273839 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273627    6064 cpu_manager.go:414] "containerMap: removing container" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="storage-initializer"
Oct 30 19:16:16.273839 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273635    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="storage-initializer"
Oct 30 19:16:16.273839 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273821    6064 cpu_manager.go:414] "containerMap: removing container" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kserve-container"
Oct 30 19:16:16.273839 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273832    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kserve-container"
Oct 30 19:16:16.273969 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273920    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kserve-container"
Oct 30 19:16:16.273969 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.273932    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" containerName="kube-rbac-proxy"
Oct 30 19:16:16.296409 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.296388    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"]
Oct 30 19:16:16.296523 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.296479    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.302040 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302018    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"seaweedfs-s3-creds\""
Oct 30 19:16:16.302165 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302083    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:16:16.302431 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302408    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:16:16.302546 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302445    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-xgboost-predictor-serving-cert\""
Oct 30 19:16:16.302546 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302461    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-xgboost-kube-rbac-proxy-sar-config\""
Oct 30 19:16:16.302546 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302491    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:16:16.302763 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.302560    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:16:16.309913 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.309890    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.309993 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.309933    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.310043 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.310018    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.310104 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.310085    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kztkv\" (UniqueName: \"kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.310142 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.310132    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.410981 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.410956    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411081 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.410996    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411081 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.411026    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411081 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.411061    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kztkv\" (UniqueName: \"kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411256 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.411082    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411354 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.411336    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.411698    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.411779 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.411760    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.413537 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.413516    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.423445 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.423421    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kztkv\" (UniqueName: \"kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv\") pod \"isvc-xgboost-predictor-7d946b8c-gzbcs\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") " pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.664053 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.664030    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:16.956576 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:16.956504    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"]
Oct 30 19:16:16.960396 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:16:16.960368    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21252978_f635_42e8_b008_2cfc5fc32e77.slice/crio-da2069277acec640cf47abae06bfd0209be0e5380d5e97ac3e9c3d791a5cfb16 WatchSource:0}: Error finding container da2069277acec640cf47abae06bfd0209be0e5380d5e97ac3e9c3d791a5cfb16: Status 404 returned error can't find the container with id da2069277acec640cf47abae06bfd0209be0e5380d5e97ac3e9c3d791a5cfb16
Oct 30 19:16:17.238374 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:17.238303    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0907a64-8c2d-4523-b1be-e23e09813466" path="/var/lib/kubelet/pods/a0907a64-8c2d-4523-b1be-e23e09813466/volumes"
Oct 30 19:16:17.616940 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:17.616894    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerStarted","Data":"fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15"}
Oct 30 19:16:17.617136 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:17.616975    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerStarted","Data":"da2069277acec640cf47abae06bfd0209be0e5380d5e97ac3e9c3d791a5cfb16"}
Oct 30 19:16:21.633472 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:21.633442    6064 generic.go:356] "Generic (PLEG): container finished" podID="21252978-f635-42e8-b008-2cfc5fc32e77" containerID="fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15" exitCode=0
Oct 30 19:16:21.634058 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:21.633486    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerDied","Data":"fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15"}
Oct 30 19:16:23.061958 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:16:23.061922    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:16:40.717978 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:40.717947    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerStarted","Data":"9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b"}
Oct 30 19:16:40.718378 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:40.718012    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerStarted","Data":"3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5"}
Oct 30 19:16:40.718378 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:40.718198    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:40.740816 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:40.740758    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podStartSLOduration=2.161562743 podStartE2EDuration="24.740741902s" totalImagesPullingTime="18.487051709s" totalInitContainerRuntime="4.09212745s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:16:40.739433416 +0000 UTC m=+2339.617706235" watchObservedRunningTime="2026-10-30 19:16:40.740741902 +0000 UTC m=+2339.619014720"
Oct 30 19:16:41.722215 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:41.722190    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:41.723468 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:41.723440    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:16:42.725507 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:42.725465    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:16:47.729997 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:47.729961    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:16:47.730493 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:47.730447    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:16:53.059386 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:16:53.059298    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:16:57.730869 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:16:57.730834    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:17:07.730566 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:07.730526    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:17:17.731342 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:17.731298    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:17:23.059103 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:17:23.059066    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:17:27.730803 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:27.730767    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:17:37.730486 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:37.730449    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:17:41.478667 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:41.478612    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:17:41.485228 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:41.485206    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:17:47.730825 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:47.730792    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:17:53.059724 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:17:53.059681    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:17:57.071753 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:57.071718    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"]
Oct 30 19:17:57.072275 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:57.071939    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" containerID="cri-o://3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5" gracePeriod=30
Oct 30 19:17:57.072275 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:57.071980    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kube-rbac-proxy" containerID="cri-o://9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b" gracePeriod=30
Oct 30 19:17:57.725958 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:57.725919    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.37:8643/healthz\": dial tcp 10.134.0.37:8643: connect: connection refused"
Oct 30 19:17:57.732767 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:57.732732    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Oct 30 19:17:58.016472 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:58.016397    6064 generic.go:356] "Generic (PLEG): container finished" podID="21252978-f635-42e8-b008-2cfc5fc32e77" containerID="9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b" exitCode=0
Oct 30 19:17:58.016608 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:17:58.016471    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerDied","Data":"9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b"}
Oct 30 19:18:00.714507 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.714486    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:18:00.828708 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.828631    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert\") pod \"21252978-f635-42e8-b008-2cfc5fc32e77\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") "
Oct 30 19:18:00.828708 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.828680    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls\" (UniqueName: \"kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls\") pod \"21252978-f635-42e8-b008-2cfc5fc32e77\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") "
Oct 30 19:18:00.828890 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.828723    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location\") pod \"21252978-f635-42e8-b008-2cfc5fc32e77\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") "
Oct 30 19:18:00.828890 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.828744    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config\") pod \"21252978-f635-42e8-b008-2cfc5fc32e77\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") "
Oct 30 19:18:00.828890 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.828759    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv\" (UniqueName: \"kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv\") pod \"21252978-f635-42e8-b008-2cfc5fc32e77\" (UID: \"21252978-f635-42e8-b008-2cfc5fc32e77\") "
Oct 30 19:18:00.829053 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.828994    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert" pod "21252978-f635-42e8-b008-2cfc5fc32e77" (UID: "21252978-f635-42e8-b008-2cfc5fc32e77"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:18:00.829114 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.829053    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location" pod "21252978-f635-42e8-b008-2cfc5fc32e77" (UID: "21252978-f635-42e8-b008-2cfc5fc32e77"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:18:00.829199 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.829172    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config" pod "21252978-f635-42e8-b008-2cfc5fc32e77" (UID: "21252978-f635-42e8-b008-2cfc5fc32e77"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:18:00.831054 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.831025    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv" pod "21252978-f635-42e8-b008-2cfc5fc32e77" (UID: "21252978-f635-42e8-b008-2cfc5fc32e77"). InnerVolumeSpecName "kube-api-access-kztkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:18:00.831054 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.831035    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls" pod "21252978-f635-42e8-b008-2cfc5fc32e77" (UID: "21252978-f635-42e8-b008-2cfc5fc32e77"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:18:00.929532 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.929511    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:18:00.929532 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.929531    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21252978-f635-42e8-b008-2cfc5fc32e77-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:18:00.929677 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.929540    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21252978-f635-42e8-b008-2cfc5fc32e77-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:18:00.929677 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.929550    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21252978-f635-42e8-b008-2cfc5fc32e77-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:18:00.929677 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:00.929559    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kztkv\" (UniqueName: \"kubernetes.io/projected/21252978-f635-42e8-b008-2cfc5fc32e77-kube-api-access-kztkv\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:18:01.029820 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.029787    6064 generic.go:356] "Generic (PLEG): container finished" podID="21252978-f635-42e8-b008-2cfc5fc32e77" containerID="3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5" exitCode=0
Oct 30 19:18:01.029933 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.029846    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerDied","Data":"3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5"}
Oct 30 19:18:01.029933 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.029873    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"
Oct 30 19:18:01.029933 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.029910    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs" event={"ID":"21252978-f635-42e8-b008-2cfc5fc32e77","Type":"ContainerDied","Data":"da2069277acec640cf47abae06bfd0209be0e5380d5e97ac3e9c3d791a5cfb16"}
Oct 30 19:18:01.030112 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.029948    6064 scope.go:122] "RemoveContainer" containerID="9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b"
Oct 30 19:18:01.038788 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.038772    6064 scope.go:122] "RemoveContainer" containerID="3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5"
Oct 30 19:18:01.046396 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.046381    6064 scope.go:122] "RemoveContainer" containerID="fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15"
Oct 30 19:18:01.050999 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.050977    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"]
Oct 30 19:18:01.054473 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.054455    6064 scope.go:122] "RemoveContainer" containerID="9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b"
Oct 30 19:18:01.054867 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:18:01.054816    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b\": container with ID starting with 9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b not found: ID does not exist" containerID="9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b"
Oct 30 19:18:01.054992 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.054882    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b"} err="failed to get container status \"9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b\": rpc error: code = NotFound desc = could not find container \"9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b\": container with ID starting with 9c3fd5de26735eb06452979569527769ebc790413aa79b01ed573043cde7858b not found: ID does not exist"
Oct 30 19:18:01.054992 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.054913    6064 scope.go:122] "RemoveContainer" containerID="3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5"
Oct 30 19:18:01.055572 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.055546    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-xgboost-predictor-7d946b8c-gzbcs"]
Oct 30 19:18:01.055813 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:18:01.055788    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5\": container with ID starting with 3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5 not found: ID does not exist" containerID="3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5"
Oct 30 19:18:01.055877 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.055820    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5"} err="failed to get container status \"3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5\": rpc error: code = NotFound desc = could not find container \"3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5\": container with ID starting with 3da5be971be849bac32e2d60b6827a5eabe52d7340f47b232b0cdfb3c998f7b5 not found: ID does not exist"
Oct 30 19:18:01.055877 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.055836    6064 scope.go:122] "RemoveContainer" containerID="fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15"
Oct 30 19:18:01.056120 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:18:01.056102    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15\": container with ID starting with fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15 not found: ID does not exist" containerID="fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15"
Oct 30 19:18:01.056164 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.056129    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15"} err="failed to get container status \"fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15\": rpc error: code = NotFound desc = could not find container \"fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15\": container with ID starting with fc3eaa8a31a638759056bbaf70bd325e966973113b0bea7050d3fe5991cbca15 not found: ID does not exist"
Oct 30 19:18:01.237597 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:01.237573    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" path="/var/lib/kubelet/pods/21252978-f635-42e8-b008-2cfc5fc32e77/volumes"
Oct 30 19:18:23.060797 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:18:23.060688    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:18:42.261585 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.261540    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"]
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.261971    6064 cpu_manager.go:414] "containerMap: removing container" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container"
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.261996    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container"
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.262027    6064 cpu_manager.go:414] "containerMap: removing container" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="storage-initializer"
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.262033    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="storage-initializer"
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.262046    6064 cpu_manager.go:414] "containerMap: removing container" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kube-rbac-proxy"
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.262051    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kube-rbac-proxy"
Oct 30 19:18:42.262116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.262115    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kserve-container"
Oct 30 19:18:42.262390 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.262128    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="21252978-f635-42e8-b008-2cfc5fc32e77" containerName="kube-rbac-proxy"
Oct 30 19:18:42.266364 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.266345    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.280771 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.280742    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"]
Oct 30 19:18:42.325418 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.325392    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:18:42.325418 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.325393    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Oct 30 19:18:42.325601 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.325529    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:18:42.325638 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.325601    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:18:42.326536 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.326523    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:18:42.326621 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.326575    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-create-predictor-serving-cert\""
Oct 30 19:18:42.326736 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.326722    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:18:42.336108 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.336087    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.336174 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.336135    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.336281 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.336266    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9c47\" (UniqueName: \"kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.336315 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.336295    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.336351 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.336328    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.437455 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.437424    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.437561 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.437480    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9c47\" (UniqueName: \"kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.437561 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.437524    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.437648 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.437566    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.437648 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.437600    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.438052 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.438029    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.438378 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.438356    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.438628 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.438363    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.440406 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.440381    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.449768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.449746    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9c47\" (UniqueName: \"kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47\") pod \"isvc-canary-create-predictor-9b6f958d8-7vn68\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") " pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.584299 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.584267    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:18:42.866332 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:42.866263    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"]
Oct 30 19:18:42.873338 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:18:42.873252    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90f6cb2_43cc_4bba_ae01_f1f337fee201.slice/crio-f13f763517f1303031ad57c823fdc444b6295168e8f53101b50c81c03e7b41a4 WatchSource:0}: Error finding container f13f763517f1303031ad57c823fdc444b6295168e8f53101b50c81c03e7b41a4: Status 404 returned error can't find the container with id f13f763517f1303031ad57c823fdc444b6295168e8f53101b50c81c03e7b41a4
Oct 30 19:18:43.196699 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:43.196604    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerStarted","Data":"a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be"}
Oct 30 19:18:43.196699 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:43.196686    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerStarted","Data":"f13f763517f1303031ad57c823fdc444b6295168e8f53101b50c81c03e7b41a4"}
Oct 30 19:18:47.214525 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:47.214487    6064 generic.go:356] "Generic (PLEG): container finished" podID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerID="a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be" exitCode=0
Oct 30 19:18:47.214993 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:47.214562    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerDied","Data":"a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be"}
Oct 30 19:18:47.215779 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:18:47.215765    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:18:53.064619 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:18:53.064574    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:19:01.292846 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:01.292815    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerStarted","Data":"1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d"}
Oct 30 19:19:01.293265 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:01.292874    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerStarted","Data":"e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d"}
Oct 30 19:19:01.293265 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:01.293169    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:19:01.293265 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:01.293226    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:19:01.294639 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:01.294617    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:01.315253 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:01.315213    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podStartSLOduration=1.910557644 podStartE2EDuration="19.31520407s" totalImagesPullingTime="13.590543453s" totalInitContainerRuntime="3.814102973s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:19:01.3135135 +0000 UTC m=+2480.191786319" watchObservedRunningTime="2026-10-30 19:19:01.31520407 +0000 UTC m=+2480.193476890"
Oct 30 19:19:02.297583 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:02.297540    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:07.302141 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:07.302113    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:19:07.302705 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:07.302675    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:17.303076 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:17.303038    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:23.060444 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:19:23.060405    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:19:27.302620 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:27.302584    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:37.302549 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:37.302512    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:47.303398 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:47.303359    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:19:53.060165 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:19:53.060080    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:19:57.302534 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:19:57.302502    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:20:07.303211 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:07.303175    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Oct 30 19:20:17.303409 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:17.303380    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:20:22.438862 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:22.438827    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"]
Oct 30 19:20:22.439252 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:22.439055    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container" containerID="cri-o://e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d" gracePeriod=30
Oct 30 19:20:22.439252 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:22.439096    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kube-rbac-proxy" containerID="cri-o://1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d" gracePeriod=30
Oct 30 19:20:22.608168 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:22.608138    6064 generic.go:356] "Generic (PLEG): container finished" podID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerID="1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d" exitCode=0
Oct 30 19:20:22.608308 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:22.608211    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerDied","Data":"1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d"}
Oct 30 19:20:23.059347 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:20:23.059316    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:20:26.773258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.773233    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:20:26.871759 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.871704    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config\") pod \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") "
Oct 30 19:20:26.871868 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.871759    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location\") pod \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") "
Oct 30 19:20:26.871868 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.871782    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls\" (UniqueName: \"kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls\") pod \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") "
Oct 30 19:20:26.871868 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.871827    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert\") pod \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") "
Oct 30 19:20:26.871868 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.871863    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47\" (UniqueName: \"kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47\") pod \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\" (UID: \"b90f6cb2-43cc-4bba-ae01-f1f337fee201\") "
Oct 30 19:20:26.872130 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.872109    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config" pod "b90f6cb2-43cc-4bba-ae01-f1f337fee201" (UID: "b90f6cb2-43cc-4bba-ae01-f1f337fee201"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:20:26.872203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.872139    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location" pod "b90f6cb2-43cc-4bba-ae01-f1f337fee201" (UID: "b90f6cb2-43cc-4bba-ae01-f1f337fee201"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:20:26.872203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.872188    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert" pod "b90f6cb2-43cc-4bba-ae01-f1f337fee201" (UID: "b90f6cb2-43cc-4bba-ae01-f1f337fee201"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:20:26.873976 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.873952    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls" pod "b90f6cb2-43cc-4bba-ae01-f1f337fee201" (UID: "b90f6cb2-43cc-4bba-ae01-f1f337fee201"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:20:26.874082 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.874058    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47" pod "b90f6cb2-43cc-4bba-ae01-f1f337fee201" (UID: "b90f6cb2-43cc-4bba-ae01-f1f337fee201"). InnerVolumeSpecName "kube-api-access-h9c47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:20:26.972543 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.972519    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:20:26.972543 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.972538    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:20:26.972700 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.972548    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b90f6cb2-43cc-4bba-ae01-f1f337fee201-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:20:26.972700 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.972558    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b90f6cb2-43cc-4bba-ae01-f1f337fee201-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:20:26.972700 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:26.972568    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9c47\" (UniqueName: \"kubernetes.io/projected/b90f6cb2-43cc-4bba-ae01-f1f337fee201-kube-api-access-h9c47\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:20:27.629639 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.629609    6064 generic.go:356] "Generic (PLEG): container finished" podID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerID="e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d" exitCode=0
Oct 30 19:20:27.629808 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.629678    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"
Oct 30 19:20:27.629808 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.629687    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerDied","Data":"e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d"}
Oct 30 19:20:27.629808 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.629748    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68" event={"ID":"b90f6cb2-43cc-4bba-ae01-f1f337fee201","Type":"ContainerDied","Data":"f13f763517f1303031ad57c823fdc444b6295168e8f53101b50c81c03e7b41a4"}
Oct 30 19:20:27.629808 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.629774    6064 scope.go:122] "RemoveContainer" containerID="1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d"
Oct 30 19:20:27.638162 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.638144    6064 scope.go:122] "RemoveContainer" containerID="e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d"
Oct 30 19:20:27.645463 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.645444    6064 scope.go:122] "RemoveContainer" containerID="a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be"
Oct 30 19:20:27.652347 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.652332    6064 scope.go:122] "RemoveContainer" containerID="1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d"
Oct 30 19:20:27.652590 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:20:27.652572    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d\": container with ID starting with 1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d not found: ID does not exist" containerID="1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d"
Oct 30 19:20:27.652680 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.652601    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d"} err="failed to get container status \"1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d\": rpc error: code = NotFound desc = could not find container \"1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d\": container with ID starting with 1b500eca7923f4469f2d68c9f4e2ece270ba3079d81728834b564f9d45fee68d not found: ID does not exist"
Oct 30 19:20:27.652680 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.652623    6064 scope.go:122] "RemoveContainer" containerID="e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d"
Oct 30 19:20:27.653026 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:20:27.653008    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d\": container with ID starting with e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d not found: ID does not exist" containerID="e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d"
Oct 30 19:20:27.653070 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.653035    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d"} err="failed to get container status \"e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d\": rpc error: code = NotFound desc = could not find container \"e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d\": container with ID starting with e27e30836ace71a51fdd3d3e9608d864c33673d0ece2cc16e71b659df5cdac8d not found: ID does not exist"
Oct 30 19:20:27.653070 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.653049    6064 scope.go:122] "RemoveContainer" containerID="a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be"
Oct 30 19:20:27.653266 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:20:27.653249    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be\": container with ID starting with a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be not found: ID does not exist" containerID="a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be"
Oct 30 19:20:27.653318 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.653274    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be"} err="failed to get container status \"a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be\": rpc error: code = NotFound desc = could not find container \"a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be\": container with ID starting with a0283f760e83775eb2aed627c10c20476bb925fabca7205fb226491e64bba7be not found: ID does not exist"
Oct 30 19:20:27.657735 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.657716    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"]
Oct 30 19:20:27.663312 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:27.663296    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-create-predictor-9b6f958d8-7vn68"]
Oct 30 19:20:29.237147 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:29.237112    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" path="/var/lib/kubelet/pods/b90f6cb2-43cc-4bba-ae01-f1f337fee201/volumes"
Oct 30 19:20:30.189467 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.189430    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"]
Oct 30 19:20:30.190194 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190163    6064 cpu_manager.go:414] "containerMap: removing container" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container"
Oct 30 19:20:30.190194 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190187    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container"
Oct 30 19:20:30.190366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190204    6064 cpu_manager.go:414] "containerMap: removing container" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="storage-initializer"
Oct 30 19:20:30.190366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190210    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="storage-initializer"
Oct 30 19:20:30.190366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190222    6064 cpu_manager.go:414] "containerMap: removing container" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kube-rbac-proxy"
Oct 30 19:20:30.190366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190227    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kube-rbac-proxy"
Oct 30 19:20:30.190366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190290    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kserve-container"
Oct 30 19:20:30.190366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.190300    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="b90f6cb2-43cc-4bba-ae01-f1f337fee201" containerName="kube-rbac-proxy"
Oct 30 19:20:30.194803 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.194786    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.209154 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.209126    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"]
Oct 30 19:20:30.242504 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.242482    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-promote-predictor-serving-cert\""
Oct 30 19:20:30.242933 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.242875    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:20:30.242933 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.242882    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:20:30.243169 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.243151    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:20:30.243252 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.243197    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:20:30.243252 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.243200    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Oct 30 19:20:30.243321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.243250    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:20:30.295834 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.295805    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.295928 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.295845    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.295928 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.295876    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.296005 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.295968    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5gnw\" (UniqueName: \"kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.296005 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.295993    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.397170 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397145    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.397262 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397176    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.397262 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397196    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.397262 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397216    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5gnw\" (UniqueName: \"kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.397262 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397232    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.397640 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397622    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.398000 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397982    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.398095 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.397998    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.399689 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.399670    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.411025 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.411004    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5gnw\" (UniqueName: \"kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw\") pod \"isvc-canary-promote-predictor-5d456c5878-xfmhl\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.511771 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.511716    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:30.795753 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:30.795677    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"]
Oct 30 19:20:30.800029 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:20:30.800007    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9d4b2c_2ec1_476d_9f03_743fe6598e6d.slice/crio-a124a2c855e4f4d6d78453ee681d250a9cbabd5c93f595f19506711cb3301d24 WatchSource:0}: Error finding container a124a2c855e4f4d6d78453ee681d250a9cbabd5c93f595f19506711cb3301d24: Status 404 returned error can't find the container with id a124a2c855e4f4d6d78453ee681d250a9cbabd5c93f595f19506711cb3301d24
Oct 30 19:20:31.647296 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:31.647262    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerStarted","Data":"7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6"}
Oct 30 19:20:31.647771 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:31.647335    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerStarted","Data":"a124a2c855e4f4d6d78453ee681d250a9cbabd5c93f595f19506711cb3301d24"}
Oct 30 19:20:35.665114 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:35.665073    6064 generic.go:356] "Generic (PLEG): container finished" podID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerID="7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6" exitCode=0
Oct 30 19:20:35.665594 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:35.665129    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerDied","Data":"7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6"}
Oct 30 19:20:36.670900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:36.670867    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerStarted","Data":"f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32"}
Oct 30 19:20:36.671261 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:36.670928    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerStarted","Data":"79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d"}
Oct 30 19:20:36.671261 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:36.671108    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:36.701463 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:36.701415    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podStartSLOduration=2.901448986 podStartE2EDuration="6.701401385s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.799952399s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:20:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:20:36.693975051 +0000 UTC m=+2575.572247871" watchObservedRunningTime="2026-10-30 19:20:36.701401385 +0000 UTC m=+2575.579674198"
Oct 30 19:20:37.675285 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:37.675255    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:37.676534 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:37.676507    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:20:38.678849 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:38.678803    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:20:43.682805 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:43.682774    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:20:43.683380 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:43.683350    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:20:53.059145 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:20:53.059100    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:20:53.683673 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:20:53.683616    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:21:03.683322 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:21:03.683283    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:21:13.684014 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:21:13.683972    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:21:23.060445 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:21:23.060368    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:21:23.683397 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:21:23.683356    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:21:33.683838 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:21:33.683794    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:21:43.684038 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:21:43.684002    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:21:53.065310 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:21:53.065266    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:21:53.684485 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:21:53.684455    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:22:10.291833 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.291801    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"]
Oct 30 19:22:10.292232 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.292065    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" containerID="cri-o://79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d" gracePeriod=30
Oct 30 19:22:10.292232 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.292094    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kube-rbac-proxy" containerID="cri-o://f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32" gracePeriod=30
Oct 30 19:22:10.362822 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.362796    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"]
Oct 30 19:22:10.366375 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.366355    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.372072 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.372050    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Oct 30 19:22:10.386021 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.385994    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"]
Oct 30 19:22:10.419019 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.418995    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.419143 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.419041    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.419211 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.419188    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wstqp\" (UniqueName: \"kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.419264 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.419231    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.419320 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.419298    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.520410 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.520384    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.520512 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.520445    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wstqp\" (UniqueName: \"kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.520512 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.520465    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.520512 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.520481    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.520512 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.520502    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.520948 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.520926    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.521154 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.521126    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.521255 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.521163    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.522966 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.522948    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.532462 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.532435    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wstqp\" (UniqueName: \"kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp\") pod \"isvc-canary-promote-v2-predictor-7565fb54fc-ml74f\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") " pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.683618 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.683594    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:10.976047 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:10.975976    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"]
Oct 30 19:22:10.980317 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:22:10.980290    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45803280_d29e_4a25_b976_88efed9bdbbc.slice/crio-bfbfa91c68b64c5b71b92aa6be875083dded4ad0c6437d6cd72529f86a1384e8 WatchSource:0}: Error finding container bfbfa91c68b64c5b71b92aa6be875083dded4ad0c6437d6cd72529f86a1384e8: Status 404 returned error can't find the container with id bfbfa91c68b64c5b71b92aa6be875083dded4ad0c6437d6cd72529f86a1384e8
Oct 30 19:22:11.033418 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:11.033390    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerStarted","Data":"bfbfa91c68b64c5b71b92aa6be875083dded4ad0c6437d6cd72529f86a1384e8"}
Oct 30 19:22:11.035431 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:11.035409    6064 generic.go:356] "Generic (PLEG): container finished" podID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerID="f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32" exitCode=0
Oct 30 19:22:11.035534 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:11.035476    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerDied","Data":"f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32"}
Oct 30 19:22:12.040914 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:12.040877    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerStarted","Data":"5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3"}
Oct 30 19:22:13.679665 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:13.679623    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.39:8643/healthz\": dial tcp 10.134.0.39:8643: connect: connection refused"
Oct 30 19:22:13.683706 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:13.683681    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 19:22:14.637470 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.637447    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:22:14.649564 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649542    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert\") pod \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") "
Oct 30 19:22:14.649646 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649621    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config\") pod \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") "
Oct 30 19:22:14.649708 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649675    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location\") pod \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") "
Oct 30 19:22:14.649708 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649698    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls\") pod \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") "
Oct 30 19:22:14.649810 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649736    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw\" (UniqueName: \"kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw\") pod \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\" (UID: \"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d\") "
Oct 30 19:22:14.649983 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649955    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config" pod "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" (UID: "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:22:14.649983 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.649967    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert" pod "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" (UID: "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:22:14.650109 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.650059    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location" pod "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" (UID: "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:22:14.651931 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.651905    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw" pod "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" (UID: "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d"). InnerVolumeSpecName "kube-api-access-h5gnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:22:14.651931 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.651923    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls" pod "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" (UID: "6b9d4b2c-2ec1-476d-9f03-743fe6598e6d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:22:14.750476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.750400    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:22:14.750476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.750428    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:22:14.750476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.750443    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:22:14.750476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.750456    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5gnw\" (UniqueName: \"kubernetes.io/projected/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-kube-api-access-h5gnw\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:22:14.750476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:14.750468    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:22:15.054938 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.054862    6064 generic.go:356] "Generic (PLEG): container finished" podID="45803280-d29e-4a25-b976-88efed9bdbbc" containerID="5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3" exitCode=0
Oct 30 19:22:15.055086 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.054935    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerDied","Data":"5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3"}
Oct 30 19:22:15.057108 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.057085    6064 generic.go:356] "Generic (PLEG): container finished" podID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerID="79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d" exitCode=0
Oct 30 19:22:15.057218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.057123    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerDied","Data":"79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d"}
Oct 30 19:22:15.057218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.057162    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl" event={"ID":"6b9d4b2c-2ec1-476d-9f03-743fe6598e6d","Type":"ContainerDied","Data":"a124a2c855e4f4d6d78453ee681d250a9cbabd5c93f595f19506711cb3301d24"}
Oct 30 19:22:15.057218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.057187    6064 scope.go:122] "RemoveContainer" containerID="f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32"
Oct 30 19:22:15.057373 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.057357    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"
Oct 30 19:22:15.066138 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.066121    6064 scope.go:122] "RemoveContainer" containerID="79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d"
Oct 30 19:22:15.074985 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.074968    6064 scope.go:122] "RemoveContainer" containerID="7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6"
Oct 30 19:22:15.089240 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.089221    6064 scope.go:122] "RemoveContainer" containerID="f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32"
Oct 30 19:22:15.089537 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:22:15.089521    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32\": container with ID starting with f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32 not found: ID does not exist" containerID="f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32"
Oct 30 19:22:15.089598 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.089550    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32"} err="failed to get container status \"f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32\": rpc error: code = NotFound desc = could not find container \"f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32\": container with ID starting with f3858cf416ed4f7f4aff93c8b7dd7069ff4dff32b78340bf9136f654ce399f32 not found: ID does not exist"
Oct 30 19:22:15.089598 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.089567    6064 scope.go:122] "RemoveContainer" containerID="79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d"
Oct 30 19:22:15.089816 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:22:15.089802    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d\": container with ID starting with 79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d not found: ID does not exist" containerID="79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d"
Oct 30 19:22:15.089863 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.089821    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d"} err="failed to get container status \"79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d\": rpc error: code = NotFound desc = could not find container \"79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d\": container with ID starting with 79186f1281d24626fa30d3f583c1a7994e5c05dc224ea7244e54de479f18ac0d not found: ID does not exist"
Oct 30 19:22:15.089863 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.089839    6064 scope.go:122] "RemoveContainer" containerID="7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6"
Oct 30 19:22:15.090136 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:22:15.090107    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6\": container with ID starting with 7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6 not found: ID does not exist" containerID="7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6"
Oct 30 19:22:15.090136 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.090130    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6"} err="failed to get container status \"7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6\": rpc error: code = NotFound desc = could not find container \"7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6\": container with ID starting with 7df7f9b6b1b8c1e0968b694abd297e4753d63ab800d93e4916f32028ab1317d6 not found: ID does not exist"
Oct 30 19:22:15.095267 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.095243    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"]
Oct 30 19:22:15.100329 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.100309    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-predictor-5d456c5878-xfmhl"]
Oct 30 19:22:15.238039 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:15.238000    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" path="/var/lib/kubelet/pods/6b9d4b2c-2ec1-476d-9f03-743fe6598e6d/volumes"
Oct 30 19:22:16.063054 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:16.063022    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerStarted","Data":"1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661"}
Oct 30 19:22:16.063460 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:16.063093    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerStarted","Data":"cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c"}
Oct 30 19:22:16.063460 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:16.063393    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:16.063584 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:16.063547    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:16.064820 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:16.064793    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:22:16.086519 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:16.086472    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podStartSLOduration=2.3551623 podStartE2EDuration="6.08646061s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.73129831s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:22:16.084434174 +0000 UTC m=+2674.962706994" watchObservedRunningTime="2026-10-30 19:22:16.08646061 +0000 UTC m=+2674.964733408"
Oct 30 19:22:17.068926 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:17.068886    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:22:22.073785 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:22.073753    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:22:22.074235 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:22.074210    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:22:23.059181 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:22:23.059144    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:22:32.074415 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:32.074376    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:22:41.513607 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:41.513574    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:22:41.519714 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:41.519640    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:22:42.074703 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:42.074648    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:22:52.074206 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:22:52.074128    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:22:53.059140 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:22:53.059103    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:23:02.074232 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:02.074194    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:23:12.074257 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:12.074216    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:23:22.074253 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:22.074213    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:23:23.059022 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:23:23.058980    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:23:32.074869 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:32.074827    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:23:40.683949 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:40.683912    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"]
Oct 30 19:23:40.684373 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:40.684186    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" containerID="cri-o://cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c" gracePeriod=30
Oct 30 19:23:40.684373 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:40.684277    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kube-rbac-proxy" containerID="cri-o://1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661" gracePeriod=30
Oct 30 19:23:41.391929 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:41.391893    6064 generic.go:356] "Generic (PLEG): container finished" podID="45803280-d29e-4a25-b976-88efed9bdbbc" containerID="1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661" exitCode=0
Oct 30 19:23:41.392085 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:41.391963    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerDied","Data":"1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661"}
Oct 30 19:23:42.069774 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:42.069725    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Oct 30 19:23:42.074220 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:42.074173    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Oct 30 19:23:45.028113 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.028091    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:23:45.147597 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.147575    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location\") pod \"45803280-d29e-4a25-b976-88efed9bdbbc\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") "
Oct 30 19:23:45.147768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.147618    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls\" (UniqueName: \"kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls\") pod \"45803280-d29e-4a25-b976-88efed9bdbbc\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") "
Oct 30 19:23:45.147768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.147673    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert\") pod \"45803280-d29e-4a25-b976-88efed9bdbbc\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") "
Oct 30 19:23:45.147768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.147744    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp\" (UniqueName: \"kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp\") pod \"45803280-d29e-4a25-b976-88efed9bdbbc\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") "
Oct 30 19:23:45.147949 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.147780    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config\") pod \"45803280-d29e-4a25-b976-88efed9bdbbc\" (UID: \"45803280-d29e-4a25-b976-88efed9bdbbc\") "
Oct 30 19:23:45.148006 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.147943    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location" pod "45803280-d29e-4a25-b976-88efed9bdbbc" (UID: "45803280-d29e-4a25-b976-88efed9bdbbc"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:23:45.148096 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.148082    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45803280-d29e-4a25-b976-88efed9bdbbc-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:23:45.148139 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.148085    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert" pod "45803280-d29e-4a25-b976-88efed9bdbbc" (UID: "45803280-d29e-4a25-b976-88efed9bdbbc"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:23:45.148139 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.148130    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config" pod "45803280-d29e-4a25-b976-88efed9bdbbc" (UID: "45803280-d29e-4a25-b976-88efed9bdbbc"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:23:45.149906 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.149874    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls" pod "45803280-d29e-4a25-b976-88efed9bdbbc" (UID: "45803280-d29e-4a25-b976-88efed9bdbbc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:23:45.149986 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.149972    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp" pod "45803280-d29e-4a25-b976-88efed9bdbbc" (UID: "45803280-d29e-4a25-b976-88efed9bdbbc"). InnerVolumeSpecName "kube-api-access-wstqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:23:45.248642 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.248620    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wstqp\" (UniqueName: \"kubernetes.io/projected/45803280-d29e-4a25-b976-88efed9bdbbc-kube-api-access-wstqp\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:23:45.248642 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.248642    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:23:45.248642 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.248669    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/45803280-d29e-4a25-b976-88efed9bdbbc-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:23:45.248816 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.248678    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/45803280-d29e-4a25-b976-88efed9bdbbc-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:23:45.408859 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.408803    6064 generic.go:356] "Generic (PLEG): container finished" podID="45803280-d29e-4a25-b976-88efed9bdbbc" containerID="cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c" exitCode=0
Oct 30 19:23:45.408944 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.408873    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"
Oct 30 19:23:45.408944 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.408891    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerDied","Data":"cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c"}
Oct 30 19:23:45.409014 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.408962    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f" event={"ID":"45803280-d29e-4a25-b976-88efed9bdbbc","Type":"ContainerDied","Data":"bfbfa91c68b64c5b71b92aa6be875083dded4ad0c6437d6cd72529f86a1384e8"}
Oct 30 19:23:45.409014 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.408989    6064 scope.go:122] "RemoveContainer" containerID="1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661"
Oct 30 19:23:45.417196 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.417170    6064 scope.go:122] "RemoveContainer" containerID="cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c"
Oct 30 19:23:45.424799 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.424779    6064 scope.go:122] "RemoveContainer" containerID="5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3"
Oct 30 19:23:45.426471 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.426429    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"]
Oct 30 19:23:45.431598 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.431578    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-promote-v2-predictor-7565fb54fc-ml74f"]
Oct 30 19:23:45.433152 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.433133    6064 scope.go:122] "RemoveContainer" containerID="1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661"
Oct 30 19:23:45.433425 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:23:45.433407    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661\": container with ID starting with 1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661 not found: ID does not exist" containerID="1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661"
Oct 30 19:23:45.433472 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.433434    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661"} err="failed to get container status \"1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661\": rpc error: code = NotFound desc = could not find container \"1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661\": container with ID starting with 1c3e745d9a44fe8b34887855426e1d098e556282e1a2d7a33a0c79802278f661 not found: ID does not exist"
Oct 30 19:23:45.433472 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.433453    6064 scope.go:122] "RemoveContainer" containerID="cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c"
Oct 30 19:23:45.433727 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:23:45.433709    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c\": container with ID starting with cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c not found: ID does not exist" containerID="cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c"
Oct 30 19:23:45.433776 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.433732    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c"} err="failed to get container status \"cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c\": rpc error: code = NotFound desc = could not find container \"cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c\": container with ID starting with cf90c46b86293a3ec1dcc328bd4b5d76f489113ac5fd10037e392b4c51337d0c not found: ID does not exist"
Oct 30 19:23:45.433776 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.433745    6064 scope.go:122] "RemoveContainer" containerID="5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3"
Oct 30 19:23:45.433978 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:23:45.433963    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3\": container with ID starting with 5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3 not found: ID does not exist" containerID="5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3"
Oct 30 19:23:45.434019 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:45.433985    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3"} err="failed to get container status \"5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3\": rpc error: code = NotFound desc = could not find container \"5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3\": container with ID starting with 5b6fe06be9cf761bc338d2b33d3e0b350819f4852fc4f09f3231cdc45d0e58d3 not found: ID does not exist"
Oct 30 19:23:46.347477 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347438    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"]
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347776    6064 cpu_manager.go:414] "containerMap: removing container" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347788    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347810    6064 cpu_manager.go:414] "containerMap: removing container" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="storage-initializer"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347815    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="storage-initializer"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347822    6064 cpu_manager.go:414] "containerMap: removing container" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="storage-initializer"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347827    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="storage-initializer"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347833    6064 cpu_manager.go:414] "containerMap: removing container" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347838    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347844    6064 cpu_manager.go:414] "containerMap: removing container" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kube-rbac-proxy"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347849    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kube-rbac-proxy"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347858    6064 cpu_manager.go:414] "containerMap: removing container" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kube-rbac-proxy"
Oct 30 19:23:46.347900 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347862    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kube-rbac-proxy"
Oct 30 19:23:46.348303 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347911    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kserve-container"
Oct 30 19:23:46.348303 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347921    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kserve-container"
Oct 30 19:23:46.348303 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347926    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" containerName="kube-rbac-proxy"
Oct 30 19:23:46.348303 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.347932    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b9d4b2c-2ec1-476d-9f03-743fe6598e6d" containerName="kube-rbac-proxy"
Oct 30 19:23:46.352368 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.352351    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.364796 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.364774    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:23:46.365077 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.365054    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:23:46.365209 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.365134    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-rollback-predictor-serving-cert\""
Oct 30 19:23:46.365209 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.365162    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Oct 30 19:23:46.365209 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.365176    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:23:46.365422 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.365270    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:23:46.365422 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.365416    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:23:46.366503 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.366482    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"]
Oct 30 19:23:46.458647 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.458616    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-427r4\" (UniqueName: \"kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.458789 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.458647    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.458789 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.458691    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.458915 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.458862    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.458958 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.458940    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.559923 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.559897    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560034 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.559938    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560034 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.559965    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-427r4\" (UniqueName: \"kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560034 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.559991    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560034 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.560028    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560488 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.560465    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560730 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.560700    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.560730 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.560703    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.562419 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.562397    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.585768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.585746    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-427r4\" (UniqueName: \"kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4\") pod \"isvc-canary-rollback-predictor-777dfc6864-8mzfc\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") " pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.669879 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.669827    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:46.950255 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:46.950187    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"]
Oct 30 19:23:46.954835 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:23:46.954805    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cab2a92_7db6_4e17_87b2_2c01b2066e05.slice/crio-b5a0f799cfabef4db45ef94ba3a968a34b3c45384092839b3820ffb60c772ba3 WatchSource:0}: Error finding container b5a0f799cfabef4db45ef94ba3a968a34b3c45384092839b3820ffb60c772ba3: Status 404 returned error can't find the container with id b5a0f799cfabef4db45ef94ba3a968a34b3c45384092839b3820ffb60c772ba3
Oct 30 19:23:47.238680 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:47.238589    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45803280-d29e-4a25-b976-88efed9bdbbc" path="/var/lib/kubelet/pods/45803280-d29e-4a25-b976-88efed9bdbbc/volumes"
Oct 30 19:23:47.421032 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:47.420998    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerStarted","Data":"5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba"}
Oct 30 19:23:47.421503 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:47.421064    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerStarted","Data":"b5a0f799cfabef4db45ef94ba3a968a34b3c45384092839b3820ffb60c772ba3"}
Oct 30 19:23:51.438128 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:51.438095    6064 generic.go:356] "Generic (PLEG): container finished" podID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerID="5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba" exitCode=0
Oct 30 19:23:51.438492 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:51.438138    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerDied","Data":"5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba"}
Oct 30 19:23:52.444027 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:52.443995    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerStarted","Data":"33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035"}
Oct 30 19:23:52.444474 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:52.444053    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerStarted","Data":"18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64"}
Oct 30 19:23:52.444474 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:52.444323    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:52.444474 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:52.444456    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:52.445634 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:52.445609    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:23:52.471510 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:52.471458    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podStartSLOduration=2.424740293 podStartE2EDuration="6.471443501s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.046703208s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:23:52.469164117 +0000 UTC m=+2771.347436937" watchObservedRunningTime="2026-10-30 19:23:52.471443501 +0000 UTC m=+2771.349716322"
Oct 30 19:23:53.059534 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:23:53.059499    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:23:53.447673 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:53.447611    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:23:58.452343 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:58.452310    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:23:58.452833 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:23:58.452814    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:24:08.452855 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:24:08.452813    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:24:18.452990 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:24:18.452945    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:24:23.061915 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:24:23.061829    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:24:28.453283 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:24:28.453245    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:24:38.453220 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:24:38.453170    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:24:48.452858 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:24:48.452814    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:24:53.059009 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:24:53.058968    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:24:58.453281 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:24:58.453237    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 19:25:04.233810 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:25:04.233777    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:25:23.058861 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:25:23.058822    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:25:53.060716 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:25:53.060675    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:26:23.058832 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:26:23.058793    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:26:53.058737 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:26:53.058696    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:27:06.809677 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:06.809633    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"]
Oct 30 19:27:06.810073 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:06.809915    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container" containerID="cri-o://18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64" gracePeriod=30
Oct 30 19:27:06.810073 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:06.809976    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kube-rbac-proxy" containerID="cri-o://33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035" gracePeriod=30
Oct 30 19:27:07.205591 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:07.205563    6064 generic.go:356] "Generic (PLEG): container finished" podID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerID="33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035" exitCode=0
Oct 30 19:27:07.205737 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:07.205598    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerDied","Data":"33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035"}
Oct 30 19:27:08.447946 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:08.447893    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.41:8643/healthz\": dial tcp 10.134.0.41:8643: connect: connection refused"
Oct 30 19:27:10.761850 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.761827    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:27:10.875941 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.875864    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config\") pod \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") "
Oct 30 19:27:10.875941 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.875903    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert\") pod \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") "
Oct 30 19:27:10.876116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.875946    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4\" (UniqueName: \"kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4\") pod \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") "
Oct 30 19:27:10.876116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.876053    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location\") pod \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") "
Oct 30 19:27:10.876202 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.876175    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls\") pod \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\" (UID: \"3cab2a92-7db6-4e17-87b2-2c01b2066e05\") "
Oct 30 19:27:10.876382 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.876352    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config" pod "3cab2a92-7db6-4e17-87b2-2c01b2066e05" (UID: "3cab2a92-7db6-4e17-87b2-2c01b2066e05"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:27:10.876382 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.876364    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert" pod "3cab2a92-7db6-4e17-87b2-2c01b2066e05" (UID: "3cab2a92-7db6-4e17-87b2-2c01b2066e05"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:27:10.876491 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.876351    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location" pod "3cab2a92-7db6-4e17-87b2-2c01b2066e05" (UID: "3cab2a92-7db6-4e17-87b2-2c01b2066e05"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:27:10.878248 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.878221    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4" pod "3cab2a92-7db6-4e17-87b2-2c01b2066e05" (UID: "3cab2a92-7db6-4e17-87b2-2c01b2066e05"). InnerVolumeSpecName "kube-api-access-427r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:27:10.878356 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.878347    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls" pod "3cab2a92-7db6-4e17-87b2-2c01b2066e05" (UID: "3cab2a92-7db6-4e17-87b2-2c01b2066e05"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:27:10.977706 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.977681    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cab2a92-7db6-4e17-87b2-2c01b2066e05-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:27:10.977706 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.977702    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:27:10.977842 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.977714    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cab2a92-7db6-4e17-87b2-2c01b2066e05-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:27:10.977842 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.977723    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-427r4\" (UniqueName: \"kubernetes.io/projected/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kube-api-access-427r4\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:27:10.977842 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:10.977731    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cab2a92-7db6-4e17-87b2-2c01b2066e05-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:27:11.225381 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.225318    6064 generic.go:356] "Generic (PLEG): container finished" podID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerID="18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64" exitCode=0
Oct 30 19:27:11.225495 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.225417    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerDied","Data":"18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64"}
Oct 30 19:27:11.225495 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.225443    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"
Oct 30 19:27:11.225495 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.225479    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc" event={"ID":"3cab2a92-7db6-4e17-87b2-2c01b2066e05","Type":"ContainerDied","Data":"b5a0f799cfabef4db45ef94ba3a968a34b3c45384092839b3820ffb60c772ba3"}
Oct 30 19:27:11.225593 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.225518    6064 scope.go:122] "RemoveContainer" containerID="33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035"
Oct 30 19:27:11.235194 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.235173    6064 scope.go:122] "RemoveContainer" containerID="18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64"
Oct 30 19:27:11.244342 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.244316    6064 scope.go:122] "RemoveContainer" containerID="5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba"
Oct 30 19:27:11.250394 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.250372    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"]
Oct 30 19:27:11.251884 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.251869    6064 scope.go:122] "RemoveContainer" containerID="33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035"
Oct 30 19:27:11.252123 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:27:11.252107    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035\": container with ID starting with 33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035 not found: ID does not exist" containerID="33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035"
Oct 30 19:27:11.252178 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.252131    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035"} err="failed to get container status \"33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035\": rpc error: code = NotFound desc = could not find container \"33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035\": container with ID starting with 33abf494dfb972cba7cb05cb39d0b08a60a6c2566caa94612c3d92b5671ad035 not found: ID does not exist"
Oct 30 19:27:11.252178 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.252145    6064 scope.go:122] "RemoveContainer" containerID="18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64"
Oct 30 19:27:11.252390 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:27:11.252370    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64\": container with ID starting with 18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64 not found: ID does not exist" containerID="18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64"
Oct 30 19:27:11.252449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.252399    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64"} err="failed to get container status \"18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64\": rpc error: code = NotFound desc = could not find container \"18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64\": container with ID starting with 18d0d54a9239f158d717f318623fa701d4a3106414f36ac081e9684fedc22e64 not found: ID does not exist"
Oct 30 19:27:11.252449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.252421    6064 scope.go:122] "RemoveContainer" containerID="5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba"
Oct 30 19:27:11.252673 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:27:11.252637    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba\": container with ID starting with 5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba not found: ID does not exist" containerID="5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba"
Oct 30 19:27:11.252751 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.252675    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba"} err="failed to get container status \"5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba\": rpc error: code = NotFound desc = could not find container \"5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba\": container with ID starting with 5cca3fd3568ac367b980930a49f0aaa25a35935eccb0fe07325fa090a83245ba not found: ID does not exist"
Oct 30 19:27:11.255598 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:11.255572    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-rollback-predictor-777dfc6864-8mzfc"]
Oct 30 19:27:13.237617 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:13.237577    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" path="/var/lib/kubelet/pods/3cab2a92-7db6-4e17-87b2-2c01b2066e05/volumes"
Oct 30 19:27:14.501536 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501505    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"]
Oct 30 19:27:14.501982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501882    6064 cpu_manager.go:414] "containerMap: removing container" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="storage-initializer"
Oct 30 19:27:14.501982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501900    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="storage-initializer"
Oct 30 19:27:14.501982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501928    6064 cpu_manager.go:414] "containerMap: removing container" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container"
Oct 30 19:27:14.501982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501937    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container"
Oct 30 19:27:14.501982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501971    6064 cpu_manager.go:414] "containerMap: removing container" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kube-rbac-proxy"
Oct 30 19:27:14.501982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.501977    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kube-rbac-proxy"
Oct 30 19:27:14.502250 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.502060    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kube-rbac-proxy"
Oct 30 19:27:14.502250 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.502076    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cab2a92-7db6-4e17-87b2-2c01b2066e05" containerName="kserve-container"
Oct 30 19:27:14.507131 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.507113    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.526750 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.526725    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"]
Oct 30 19:27:14.538104 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.538083    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:27:14.538212 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.538119    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-stop-predictor-serving-cert\""
Oct 30 19:27:14.538212 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.538166    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:27:14.538996 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.538980    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:27:14.539068 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.539038    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:27:14.539068 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.539051    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Oct 30 19:27:14.539149 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.539069    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:27:14.607419 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.607391    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss5tp\" (UniqueName: \"kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.607522 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.607433    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.607565 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.607520    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.607565 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.607550    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.607632 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.607588    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708207 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708179    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708335 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708217    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708335 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708266    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708335 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708302    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss5tp\" (UniqueName: \"kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708481 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708348    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708638 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708617    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708934 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708914    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.708973 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.708962    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.710856 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.710840    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.733992 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.733970    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss5tp\" (UniqueName: \"kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp\") pod \"isvc-canary-stop-predictor-667bcbb7d8-lct2f\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") " pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:14.824084 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:14.824033    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:15.105393 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:15.105311    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"]
Oct 30 19:27:15.110481 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:27:15.110452    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39ebca3_77ee_47df_a362_2a6e0fda4c4c.slice/crio-63be771de4b5fb475ea48957e3e213b84f6d9ba029762eff66bf956138b4309e WatchSource:0}: Error finding container 63be771de4b5fb475ea48957e3e213b84f6d9ba029762eff66bf956138b4309e: Status 404 returned error can't find the container with id 63be771de4b5fb475ea48957e3e213b84f6d9ba029762eff66bf956138b4309e
Oct 30 19:27:15.242694 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:15.242649    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerStarted","Data":"300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020"}
Oct 30 19:27:15.242841 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:15.242721    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerStarted","Data":"63be771de4b5fb475ea48957e3e213b84f6d9ba029762eff66bf956138b4309e"}
Oct 30 19:27:19.259220 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:19.259187    6064 generic.go:356] "Generic (PLEG): container finished" podID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerID="300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020" exitCode=0
Oct 30 19:27:19.259548 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:19.259261    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerDied","Data":"300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020"}
Oct 30 19:27:20.265063 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:20.265027    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerStarted","Data":"a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7"}
Oct 30 19:27:20.265438 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:20.265084    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerStarted","Data":"921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc"}
Oct 30 19:27:20.265438 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:20.265279    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:20.287009 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:20.286956    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podStartSLOduration=2.296444022 podStartE2EDuration="6.286942193s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.990498171s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:27:20.286140591 +0000 UTC m=+2979.164413420" watchObservedRunningTime="2026-10-30 19:27:20.286942193 +0000 UTC m=+2979.165215009"
Oct 30 19:27:21.269016 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:21.268938    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:21.270248 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:21.270225    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:27:22.275419 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:22.275383    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:27:23.059984 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:27:23.059944    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:27:27.280195 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:27.280164    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:27:27.280751 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:27.280622    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:27:37.280859 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:37.280820    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:27:41.541724 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:41.541596    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:27:41.549685 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:41.549665    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:27:47.280905 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:47.280861    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:27:53.057947 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:27:53.057909    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:27:57.281258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:27:57.281220    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:28:07.280645 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:07.280608    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:28:15.208313 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.208271    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"]
Oct 30 19:28:15.211978 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.211960    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.215061 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.215030    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-sklearn-s3-tls-global-fail-kube-rbac-proxy-sar-config\""
Oct 30 19:28:15.215174 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.215096    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"storage-config\""
Oct 30 19:28:15.215420 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.215405    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:28:15.215737 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.215720    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:28:15.216198 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.216181    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-sklearn-s3-tls-global-fail-predictor-serving-cert\""
Oct 30 19:28:15.216238 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.216214    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:28:15.226351 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.226324    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"]
Oct 30 19:28:15.364028 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.364003    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.364169 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.364041    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.364169 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.364114    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.364169 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.364157    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t86k\" (UniqueName: \"kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.465113 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.465041    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.465113 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.465081    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.465113 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.465109    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.465343 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.465149    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t86k\" (UniqueName: \"kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.465589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.465567    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.465743 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.465724    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.467605 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.467587    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.476898 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.476877    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t86k\" (UniqueName: \"kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k\") pod \"isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.534894 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.534871    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:15.812618 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:15.812533    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"]
Oct 30 19:28:15.816639 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:28:15.816611    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fc39ba_85ee_4e85_bb7d_966550886bc3.slice/crio-2d232120abe1eb16a8687abbfc5c19ce6f36fec64e2c5c0a4a736c6dacb1fec8 WatchSource:0}: Error finding container 2d232120abe1eb16a8687abbfc5c19ce6f36fec64e2c5c0a4a736c6dacb1fec8: Status 404 returned error can't find the container with id 2d232120abe1eb16a8687abbfc5c19ce6f36fec64e2c5c0a4a736c6dacb1fec8
Oct 30 19:28:16.478516 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:16.478480    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" event={"ID":"14fc39ba-85ee-4e85-bb7d-966550886bc3","Type":"ContainerStarted","Data":"a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91"}
Oct 30 19:28:16.478999 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:16.478550    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" event={"ID":"14fc39ba-85ee-4e85-bb7d-966550886bc3","Type":"ContainerStarted","Data":"2d232120abe1eb16a8687abbfc5c19ce6f36fec64e2c5c0a4a736c6dacb1fec8"}
Oct 30 19:28:17.281640 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:17.281599    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:28:22.504006 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:22.503982    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh_14fc39ba-85ee-4e85-bb7d-966550886bc3/storage-initializer/0.log"
Oct 30 19:28:22.504323 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:22.504019    6064 generic.go:356] "Generic (PLEG): container finished" podID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerID="a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91" exitCode=1
Oct 30 19:28:22.504323 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:22.504102    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" event={"ID":"14fc39ba-85ee-4e85-bb7d-966550886bc3","Type":"ContainerDied","Data":"a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91"}
Oct 30 19:28:23.058611 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:23.058567    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:28:23.512317 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:23.512290    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh_14fc39ba-85ee-4e85-bb7d-966550886bc3/storage-initializer/0.log"
Oct 30 19:28:23.512729 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:23.512375    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" event={"ID":"14fc39ba-85ee-4e85-bb7d-966550886bc3","Type":"ContainerStarted","Data":"72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3"}
Oct 30 19:28:25.201203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:25.201173    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"]
Oct 30 19:28:25.201680 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:25.201361    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer" containerID="cri-o://72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3" gracePeriod=30
Oct 30 19:28:26.741541 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.741520    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh_14fc39ba-85ee-4e85-bb7d-966550886bc3/storage-initializer/1.log"
Oct 30 19:28:26.741921 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.741906    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh_14fc39ba-85ee-4e85-bb7d-966550886bc3/storage-initializer/0.log"
Oct 30 19:28:26.744184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.744169    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:26.858541 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.858521    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls\" (UniqueName: \"kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls\") pod \"14fc39ba-85ee-4e85-bb7d-966550886bc3\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") "
Oct 30 19:28:26.858646 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.858549    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k\" (UniqueName: \"kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k\") pod \"14fc39ba-85ee-4e85-bb7d-966550886bc3\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") "
Oct 30 19:28:26.858646 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.858579    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config\") pod \"14fc39ba-85ee-4e85-bb7d-966550886bc3\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") "
Oct 30 19:28:26.858646 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.858639    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location\") pod \"14fc39ba-85ee-4e85-bb7d-966550886bc3\" (UID: \"14fc39ba-85ee-4e85-bb7d-966550886bc3\") "
Oct 30 19:28:26.858974 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.858947    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location" pod "14fc39ba-85ee-4e85-bb7d-966550886bc3" (UID: "14fc39ba-85ee-4e85-bb7d-966550886bc3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:28:26.858974 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.858955    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config" pod "14fc39ba-85ee-4e85-bb7d-966550886bc3" (UID: "14fc39ba-85ee-4e85-bb7d-966550886bc3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:28:26.860687 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.860644    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls" pod "14fc39ba-85ee-4e85-bb7d-966550886bc3" (UID: "14fc39ba-85ee-4e85-bb7d-966550886bc3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:28:26.860819 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.860723    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k" pod "14fc39ba-85ee-4e85-bb7d-966550886bc3" (UID: "14fc39ba-85ee-4e85-bb7d-966550886bc3"). InnerVolumeSpecName "kube-api-access-2t86k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:28:26.959745 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.959724    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14fc39ba-85ee-4e85-bb7d-966550886bc3-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:26.959745 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.959742    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t86k\" (UniqueName: \"kubernetes.io/projected/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-api-access-2t86k\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:26.959880 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.959752    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14fc39ba-85ee-4e85-bb7d-966550886bc3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:26.959880 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:26.959762    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14fc39ba-85ee-4e85-bb7d-966550886bc3-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:27.281603 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.281571    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:28:27.529898 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.529841    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh_14fc39ba-85ee-4e85-bb7d-966550886bc3/storage-initializer/1.log"
Oct 30 19:28:27.530265 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.530250    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh_14fc39ba-85ee-4e85-bb7d-966550886bc3/storage-initializer/0.log"
Oct 30 19:28:27.530320 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.530285    6064 generic.go:356] "Generic (PLEG): container finished" podID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerID="72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3" exitCode=1
Oct 30 19:28:27.530368 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.530319    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" event={"ID":"14fc39ba-85ee-4e85-bb7d-966550886bc3","Type":"ContainerDied","Data":"72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3"}
Oct 30 19:28:27.530368 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.530344    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"
Oct 30 19:28:27.530368 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.530362    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh" event={"ID":"14fc39ba-85ee-4e85-bb7d-966550886bc3","Type":"ContainerDied","Data":"2d232120abe1eb16a8687abbfc5c19ce6f36fec64e2c5c0a4a736c6dacb1fec8"}
Oct 30 19:28:27.530476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.530388    6064 scope.go:122] "RemoveContainer" containerID="72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3"
Oct 30 19:28:27.538886 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.538870    6064 scope.go:122] "RemoveContainer" containerID="a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91"
Oct 30 19:28:27.546202 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.546180    6064 scope.go:122] "RemoveContainer" containerID="72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3"
Oct 30 19:28:27.546472 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:27.546452    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3\": container with ID starting with 72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3 not found: ID does not exist" containerID="72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3"
Oct 30 19:28:27.546520 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.546485    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3"} err="failed to get container status \"72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3\": rpc error: code = NotFound desc = could not find container \"72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3\": container with ID starting with 72d5a47338d0aba9533874ca5559b69752a3f6a4171820a1cf7556764bd25ed3 not found: ID does not exist"
Oct 30 19:28:27.546520 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.546501    6064 scope.go:122] "RemoveContainer" containerID="a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91"
Oct 30 19:28:27.546795 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:27.546771    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91\": container with ID starting with a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91 not found: ID does not exist" containerID="a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91"
Oct 30 19:28:27.546878 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.546800    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91"} err="failed to get container status \"a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91\": rpc error: code = NotFound desc = could not find container \"a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91\": container with ID starting with a31b7c47519e21c6e1664cdf06a6ba913e1579835efa5eff8225b417225d4c91 not found: ID does not exist"
Oct 30 19:28:27.564403 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.564376    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"]
Oct 30 19:28:27.571488 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:27.571470    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-global-fail-predictor-6498f4887c-fgbqh"]
Oct 30 19:28:29.237772 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:29.237737    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" path="/var/lib/kubelet/pods/14fc39ba-85ee-4e85-bb7d-966550886bc3/volumes"
Oct 30 19:28:36.233872 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:36.233837    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:28:44.587190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:44.587149    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"]
Oct 30 19:28:44.587615 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:44.587367    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" containerID="cri-o://921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc" gracePeriod=30
Oct 30 19:28:44.587615 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:44.587416    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kube-rbac-proxy" containerID="cri-o://a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7" gracePeriod=30
Oct 30 19:28:45.602768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:45.602731    6064 generic.go:356] "Generic (PLEG): container finished" podID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerID="a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7" exitCode=0
Oct 30 19:28:45.603161 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:45.602807    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerDied","Data":"a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7"}
Oct 30 19:28:46.233550 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:46.233507    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 19:28:47.276421 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:47.276370    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.42:8643/healthz\": dial tcp 10.134.0.42:8643: connect: connection refused"
Oct 30 19:28:48.828749 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.828725    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:28:48.926963 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.926897    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config\") pod \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") "
Oct 30 19:28:48.927076 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.926962    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert\") pod \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") "
Oct 30 19:28:48.927076 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.927044    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls\" (UniqueName: \"kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls\") pod \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") "
Oct 30 19:28:48.927161 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.927097    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp\" (UniqueName: \"kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp\") pod \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") "
Oct 30 19:28:48.927161 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.927132    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location\") pod \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\" (UID: \"c39ebca3-77ee-47df-a362-2a6e0fda4c4c\") "
Oct 30 19:28:48.927332 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.927310    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config" pod "c39ebca3-77ee-47df-a362-2a6e0fda4c4c" (UID: "c39ebca3-77ee-47df-a362-2a6e0fda4c4c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:28:48.927371 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.927338    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert" pod "c39ebca3-77ee-47df-a362-2a6e0fda4c4c" (UID: "c39ebca3-77ee-47df-a362-2a6e0fda4c4c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:28:48.927531 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.927512    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location" pod "c39ebca3-77ee-47df-a362-2a6e0fda4c4c" (UID: "c39ebca3-77ee-47df-a362-2a6e0fda4c4c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:28:48.929182 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.929157    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls" pod "c39ebca3-77ee-47df-a362-2a6e0fda4c4c" (UID: "c39ebca3-77ee-47df-a362-2a6e0fda4c4c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:28:48.929270 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:48.929252    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp" pod "c39ebca3-77ee-47df-a362-2a6e0fda4c4c" (UID: "c39ebca3-77ee-47df-a362-2a6e0fda4c4c"). InnerVolumeSpecName "kube-api-access-ss5tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:28:49.027883 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.027857    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss5tp\" (UniqueName: \"kubernetes.io/projected/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-api-access-ss5tp\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:49.027883 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.027878    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:49.028026 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.027889    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:49.028026 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.027900    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:49.028026 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.027908    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c39ebca3-77ee-47df-a362-2a6e0fda4c4c-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:28:49.620012 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.619977    6064 generic.go:356] "Generic (PLEG): container finished" podID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerID="921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc" exitCode=0
Oct 30 19:28:49.620190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.620012    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerDied","Data":"921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc"}
Oct 30 19:28:49.620190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.620056    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"
Oct 30 19:28:49.620190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.620096    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f" event={"ID":"c39ebca3-77ee-47df-a362-2a6e0fda4c4c","Type":"ContainerDied","Data":"63be771de4b5fb475ea48957e3e213b84f6d9ba029762eff66bf956138b4309e"}
Oct 30 19:28:49.620190 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.620137    6064 scope.go:122] "RemoveContainer" containerID="a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7"
Oct 30 19:28:49.628735 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.628715    6064 scope.go:122] "RemoveContainer" containerID="921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc"
Oct 30 19:28:49.636396 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.636374    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"]
Oct 30 19:28:49.637345 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.637327    6064 scope.go:122] "RemoveContainer" containerID="300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020"
Oct 30 19:28:49.641260 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.641238    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-canary-stop-predictor-667bcbb7d8-lct2f"]
Oct 30 19:28:49.645378 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.645355    6064 scope.go:122] "RemoveContainer" containerID="a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7"
Oct 30 19:28:49.645684 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:49.645663    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7\": container with ID starting with a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7 not found: ID does not exist" containerID="a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7"
Oct 30 19:28:49.645757 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.645690    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7"} err="failed to get container status \"a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7\": rpc error: code = NotFound desc = could not find container \"a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7\": container with ID starting with a2c1b52ab6461c170ec51b7e575f63c59b964b814eb0cc518d8f57a03cd76db7 not found: ID does not exist"
Oct 30 19:28:49.645757 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.645708    6064 scope.go:122] "RemoveContainer" containerID="921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc"
Oct 30 19:28:49.645982 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:49.645957    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc\": container with ID starting with 921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc not found: ID does not exist" containerID="921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc"
Oct 30 19:28:49.646027 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.645988    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc"} err="failed to get container status \"921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc\": rpc error: code = NotFound desc = could not find container \"921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc\": container with ID starting with 921855ff91908af0fadd266c8d00fd97322fcc0fb2fe2a9b1e5062a3ab0fdcfc not found: ID does not exist"
Oct 30 19:28:49.646027 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.646012    6064 scope.go:122] "RemoveContainer" containerID="300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020"
Oct 30 19:28:49.646288 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:49.646268    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020\": container with ID starting with 300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020 not found: ID does not exist" containerID="300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020"
Oct 30 19:28:49.646345 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:49.646293    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020"} err="failed to get container status \"300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020\": rpc error: code = NotFound desc = could not find container \"300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020\": container with ID starting with 300fba08c9762043a4cb52fe94395552050c4b0afd2250a40c38a0180a828020 not found: ID does not exist"
Oct 30 19:28:51.244408 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:28:51.244328    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" path="/var/lib/kubelet/pods/c39ebca3-77ee-47df-a362-2a6e0fda4c4c/volumes"
Oct 30 19:28:53.059128 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:28:53.059097    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:29:23.060738 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:29:23.060700    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:29:53.059408 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:29:53.059370    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:30:10.120212 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120174    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"]
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120577    6064 cpu_manager.go:414] "containerMap: removing container" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120592    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120610    6064 cpu_manager.go:414] "containerMap: removing container" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kube-rbac-proxy"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120615    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kube-rbac-proxy"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120624    6064 cpu_manager.go:414] "containerMap: removing container" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120630    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120638    6064 cpu_manager.go:414] "containerMap: removing container" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120644    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120667    6064 cpu_manager.go:414] "containerMap: removing container" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="storage-initializer"
Oct 30 19:30:10.120684 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120671    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="storage-initializer"
Oct 30 19:30:10.121022 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120733    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kserve-container"
Oct 30 19:30:10.121022 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120744    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="c39ebca3-77ee-47df-a362-2a6e0fda4c4c" containerName="kube-rbac-proxy"
Oct 30 19:30:10.121022 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120750    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer"
Oct 30 19:30:10.121022 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.120756    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="14fc39ba-85ee-4e85-bb7d-966550886bc3" containerName="storage-initializer"
Oct 30 19:30:10.123888 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.123874    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.133926 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.133906    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-sklearn-s3-tls-custom-fail-predictor-serving-cert\""
Oct 30 19:30:10.134036 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.133936    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"storage-config\""
Oct 30 19:30:10.134036 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.133972    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:30:10.134915 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.134899    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-sklearn-s3-tls-custom-fail-kube-rbac-proxy-sar-config\""
Oct 30 19:30:10.135004 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.134979    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:30:10.135056 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.135008    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:30:10.144319 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.144283    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"]
Oct 30 19:30:10.233257 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.233232    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.233365 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.233289    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.233414 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.233397    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h5z2\" (UniqueName: \"kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.233449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.233425    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.333995 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.333963    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h5z2\" (UniqueName: \"kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.334097 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.334013    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.334097 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.334054    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.334213 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.334103    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.334489 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.334461    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.334710 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.334692    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.336578 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.336561    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.348556 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.348535    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h5z2\" (UniqueName: \"kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2\") pod \"isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.440641 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.440579    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:10.720170 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.720076    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"]
Oct 30 19:30:10.724763 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:30:10.724733    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4a3963_24d8_47fa_94fb_8d9859c57135.slice/crio-5ac776bd7f024a6310694e08d0b8ec89107fd01a7716fa277ddb2187e32a8e59 WatchSource:0}: Error finding container 5ac776bd7f024a6310694e08d0b8ec89107fd01a7716fa277ddb2187e32a8e59: Status 404 returned error can't find the container with id 5ac776bd7f024a6310694e08d0b8ec89107fd01a7716fa277ddb2187e32a8e59
Oct 30 19:30:10.947116 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.947075    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" event={"ID":"bc4a3963-24d8-47fa-94fb-8d9859c57135","Type":"ContainerStarted","Data":"f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2"}
Oct 30 19:30:10.947299 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:10.947171    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" event={"ID":"bc4a3963-24d8-47fa-94fb-8d9859c57135","Type":"ContainerStarted","Data":"5ac776bd7f024a6310694e08d0b8ec89107fd01a7716fa277ddb2187e32a8e59"}
Oct 30 19:30:14.964528 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:14.964500    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk_bc4a3963-24d8-47fa-94fb-8d9859c57135/storage-initializer/0.log"
Oct 30 19:30:14.964918 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:14.964538    6064 generic.go:356] "Generic (PLEG): container finished" podID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerID="f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2" exitCode=1
Oct 30 19:30:14.964918 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:14.964601    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" event={"ID":"bc4a3963-24d8-47fa-94fb-8d9859c57135","Type":"ContainerDied","Data":"f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2"}
Oct 30 19:30:15.969806 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:15.969777    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk_bc4a3963-24d8-47fa-94fb-8d9859c57135/storage-initializer/0.log"
Oct 30 19:30:15.970198 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:15.969834    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" event={"ID":"bc4a3963-24d8-47fa-94fb-8d9859c57135","Type":"ContainerStarted","Data":"f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6"}
Oct 30 19:30:20.112905 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:20.112863    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"]
Oct 30 19:30:20.113303 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:20.113068    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer" containerID="cri-o://f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6" gracePeriod=30
Oct 30 19:30:21.346206 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.346181    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk_bc4a3963-24d8-47fa-94fb-8d9859c57135/storage-initializer/1.log"
Oct 30 19:30:21.346590 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.346571    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk_bc4a3963-24d8-47fa-94fb-8d9859c57135/storage-initializer/0.log"
Oct 30 19:30:21.348961 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.348943    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:21.417946 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.417917    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config\") pod \"bc4a3963-24d8-47fa-94fb-8d9859c57135\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") "
Oct 30 19:30:21.418070 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418006    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location\") pod \"bc4a3963-24d8-47fa-94fb-8d9859c57135\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") "
Oct 30 19:30:21.418134 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418068    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls\") pod \"bc4a3963-24d8-47fa-94fb-8d9859c57135\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") "
Oct 30 19:30:21.418188 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418140    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2\" (UniqueName: \"kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2\") pod \"bc4a3963-24d8-47fa-94fb-8d9859c57135\" (UID: \"bc4a3963-24d8-47fa-94fb-8d9859c57135\") "
Oct 30 19:30:21.418267 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418242    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location" pod "bc4a3963-24d8-47fa-94fb-8d9859c57135" (UID: "bc4a3963-24d8-47fa-94fb-8d9859c57135"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:30:21.418324 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418267    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config" pod "bc4a3963-24d8-47fa-94fb-8d9859c57135" (UID: "bc4a3963-24d8-47fa-94fb-8d9859c57135"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:30:21.418412 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418398    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:30:21.418456 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.418419    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc4a3963-24d8-47fa-94fb-8d9859c57135-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:30:21.420306 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.420280    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2" pod "bc4a3963-24d8-47fa-94fb-8d9859c57135" (UID: "bc4a3963-24d8-47fa-94fb-8d9859c57135"). InnerVolumeSpecName "kube-api-access-6h5z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:30:21.420306 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.420286    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls" pod "bc4a3963-24d8-47fa-94fb-8d9859c57135" (UID: "bc4a3963-24d8-47fa-94fb-8d9859c57135"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:30:21.519398 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.519374    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h5z2\" (UniqueName: \"kubernetes.io/projected/bc4a3963-24d8-47fa-94fb-8d9859c57135-kube-api-access-6h5z2\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:30:21.519398 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.519396    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4a3963-24d8-47fa-94fb-8d9859c57135-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:30:21.995115 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995089    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk_bc4a3963-24d8-47fa-94fb-8d9859c57135/storage-initializer/1.log"
Oct 30 19:30:21.995548 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995529    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk_bc4a3963-24d8-47fa-94fb-8d9859c57135/storage-initializer/0.log"
Oct 30 19:30:21.995602 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995570    6064 generic.go:356] "Generic (PLEG): container finished" podID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerID="f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6" exitCode=1
Oct 30 19:30:21.995666 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995635    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"
Oct 30 19:30:21.995766 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995635    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" event={"ID":"bc4a3963-24d8-47fa-94fb-8d9859c57135","Type":"ContainerDied","Data":"f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6"}
Oct 30 19:30:21.995817 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995805    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk" event={"ID":"bc4a3963-24d8-47fa-94fb-8d9859c57135","Type":"ContainerDied","Data":"5ac776bd7f024a6310694e08d0b8ec89107fd01a7716fa277ddb2187e32a8e59"}
Oct 30 19:30:21.995856 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:21.995842    6064 scope.go:122] "RemoveContainer" containerID="f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6"
Oct 30 19:30:22.006404 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.006374    6064 scope.go:122] "RemoveContainer" containerID="f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2"
Oct 30 19:30:22.014727 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.014703    6064 scope.go:122] "RemoveContainer" containerID="f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6"
Oct 30 19:30:22.015047 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:30:22.015025    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6\": container with ID starting with f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6 not found: ID does not exist" containerID="f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6"
Oct 30 19:30:22.015127 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.015057    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6"} err="failed to get container status \"f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6\": rpc error: code = NotFound desc = could not find container \"f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6\": container with ID starting with f928d88f142c42f4847acbeb8344b6be7386102586d4e94fcc6cff59ada7e9a6 not found: ID does not exist"
Oct 30 19:30:22.015127 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.015076    6064 scope.go:122] "RemoveContainer" containerID="f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2"
Oct 30 19:30:22.015347 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:30:22.015329    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2\": container with ID starting with f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2 not found: ID does not exist" containerID="f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2"
Oct 30 19:30:22.015413 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.015348    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2"} err="failed to get container status \"f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2\": rpc error: code = NotFound desc = could not find container \"f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2\": container with ID starting with f07491e0872aa00095dd0c00d5fed85e44373eb8ed6a5c9d32352a2fea005aa2 not found: ID does not exist"
Oct 30 19:30:22.035643 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.035616    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"]
Oct 30 19:30:22.040419 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:22.040398    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-custom-fail-predictor-5566d4779c-djskk"]
Oct 30 19:30:23.059894 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:30:23.059859    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:30:23.242325 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:30:23.242289    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" path="/var/lib/kubelet/pods/bc4a3963-24d8-47fa-94fb-8d9859c57135/volumes"
Oct 30 19:30:53.059388 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:30:53.059350    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:31:23.059287 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:31:23.059244    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:31:53.059614 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:31:53.059530    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:31:55.107335 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107301    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"]
Oct 30 19:31:55.107761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107638    6064 cpu_manager.go:414] "containerMap: removing container" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer"
Oct 30 19:31:55.107761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107648    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer"
Oct 30 19:31:55.107761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107685    6064 cpu_manager.go:414] "containerMap: removing container" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer"
Oct 30 19:31:55.107761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107690    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer"
Oct 30 19:31:55.107761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107740    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer"
Oct 30 19:31:55.107761 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.107750    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc4a3963-24d8-47fa-94fb-8d9859c57135" containerName="storage-initializer"
Oct 30 19:31:55.110322 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.110300    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.123698 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.123678    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"storage-config\""
Oct 30 19:31:55.131614 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.131595    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-sklearn-s3-tls-serving-fail-predictor-serving-cert\""
Oct 30 19:31:55.131729 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.131625    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"kube-root-ca.crt\""
Oct 30 19:31:55.131774 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.131737    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"openshift-service-ca.crt\""
Oct 30 19:31:55.132413 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.132394    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"default-dockercfg-ls7pb\""
Oct 30 19:31:55.132484 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.132444    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-c83bbf5b66\"/\"isvc-sklearn-s3-tls-serving-fail-kube-rbac-proxy-sar-config\""
Oct 30 19:31:55.132768 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.132742    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"]
Oct 30 19:31:55.218256 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.218226    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.218383 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.218259    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xft8l\" (UniqueName: \"kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.218383 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.218338    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.218383 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.218358    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.319716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.319688    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.319716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.319718    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xft8l\" (UniqueName: \"kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.320093 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.320068    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.320189 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.320109    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.320482 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.320458    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.320571 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.320552    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.322610 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.322593    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.331788 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.331765    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xft8l\" (UniqueName: \"kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l\") pod \"isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") " pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.427963 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.427913    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:31:55.710342 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:55.710262    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"]
Oct 30 19:31:55.714499 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:31:55.714471    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab3765d_fbbc_4651_bf49_70045f99d7c6.slice/crio-34e350356d059dc06907e0180d44bdfa1b914b8972d2042d5a26b41966c25a85 WatchSource:0}: Error finding container 34e350356d059dc06907e0180d44bdfa1b914b8972d2042d5a26b41966c25a85: Status 404 returned error can't find the container with id 34e350356d059dc06907e0180d44bdfa1b914b8972d2042d5a26b41966c25a85
Oct 30 19:31:56.358543 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:56.358503    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" event={"ID":"2ab3765d-fbbc-4651-bf49-70045f99d7c6","Type":"ContainerStarted","Data":"12abacb36bf66a122f3a4d71186838c9d638f9ea88ec1d7d46c348fc70e3ba76"}
Oct 30 19:31:56.358932 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:31:56.358580    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" event={"ID":"2ab3765d-fbbc-4651-bf49-70045f99d7c6","Type":"ContainerStarted","Data":"34e350356d059dc06907e0180d44bdfa1b914b8972d2042d5a26b41966c25a85"}
Oct 30 19:32:01.383343 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:01.383312    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q_2ab3765d-fbbc-4651-bf49-70045f99d7c6/storage-initializer/0.log"
Oct 30 19:32:01.383775 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:01.383350    6064 generic.go:356] "Generic (PLEG): container finished" podID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerID="12abacb36bf66a122f3a4d71186838c9d638f9ea88ec1d7d46c348fc70e3ba76" exitCode=1
Oct 30 19:32:01.383775 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:01.383384    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" event={"ID":"2ab3765d-fbbc-4651-bf49-70045f99d7c6","Type":"ContainerDied","Data":"12abacb36bf66a122f3a4d71186838c9d638f9ea88ec1d7d46c348fc70e3ba76"}
Oct 30 19:32:02.389078 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:02.389050    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q_2ab3765d-fbbc-4651-bf49-70045f99d7c6/storage-initializer/0.log"
Oct 30 19:32:02.389434 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:02.389093    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" event={"ID":"2ab3765d-fbbc-4651-bf49-70045f99d7c6","Type":"ContainerStarted","Data":"eb91066d9f196cadbebd0d235a18e4e82b34c17321305817267cdcf6432d4609"}
Oct 30 19:32:05.109533 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:05.109493    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"]
Oct 30 19:32:05.110014 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:05.109790    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer" containerID="cri-o://eb91066d9f196cadbebd0d235a18e4e82b34c17321305817267cdcf6432d4609" gracePeriod=30
Oct 30 19:32:07.410819 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.410788    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q_2ab3765d-fbbc-4651-bf49-70045f99d7c6/storage-initializer/1.log"
Oct 30 19:32:07.411238 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.411221    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q_2ab3765d-fbbc-4651-bf49-70045f99d7c6/storage-initializer/0.log"
Oct 30 19:32:07.411281 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.411257    6064 generic.go:356] "Generic (PLEG): container finished" podID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerID="eb91066d9f196cadbebd0d235a18e4e82b34c17321305817267cdcf6432d4609" exitCode=1
Oct 30 19:32:07.411356 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.411330    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" event={"ID":"2ab3765d-fbbc-4651-bf49-70045f99d7c6","Type":"ContainerDied","Data":"eb91066d9f196cadbebd0d235a18e4e82b34c17321305817267cdcf6432d4609"}
Oct 30 19:32:07.411412 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.411402    6064 scope.go:122] "RemoveContainer" containerID="12abacb36bf66a122f3a4d71186838c9d638f9ea88ec1d7d46c348fc70e3ba76"
Oct 30 19:32:07.452445 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.452427    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q_2ab3765d-fbbc-4651-bf49-70045f99d7c6/storage-initializer/1.log"
Oct 30 19:32:07.455632 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.455616    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:32:07.516992 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.516966    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls\") pod \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") "
Oct 30 19:32:07.517109 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.517025    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l\" (UniqueName: \"kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l\") pod \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") "
Oct 30 19:32:07.517109 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.517067    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config\") pod \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") "
Oct 30 19:32:07.517109 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.517094    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location\") pod \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\" (UID: \"2ab3765d-fbbc-4651-bf49-70045f99d7c6\") "
Oct 30 19:32:07.517414 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.517383    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location" pod "2ab3765d-fbbc-4651-bf49-70045f99d7c6" (UID: "2ab3765d-fbbc-4651-bf49-70045f99d7c6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:32:07.517414 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.517392    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config" pod "2ab3765d-fbbc-4651-bf49-70045f99d7c6" (UID: "2ab3765d-fbbc-4651-bf49-70045f99d7c6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:32:07.519076 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.519055    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls" pod "2ab3765d-fbbc-4651-bf49-70045f99d7c6" (UID: "2ab3765d-fbbc-4651-bf49-70045f99d7c6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:32:07.519158 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.519098    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l" pod "2ab3765d-fbbc-4651-bf49-70045f99d7c6" (UID: "2ab3765d-fbbc-4651-bf49-70045f99d7c6"). InnerVolumeSpecName "kube-api-access-xft8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:32:07.618284 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.618262    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xft8l\" (UniqueName: \"kubernetes.io/projected/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-api-access-xft8l\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:32:07.618284 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.618286    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:32:07.618449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.618295    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2ab3765d-fbbc-4651-bf49-70045f99d7c6-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:32:07.618449 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:07.618304    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ab3765d-fbbc-4651-bf49-70045f99d7c6-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:32:08.415970 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:08.415944    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-c83bbf5b66_isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q_2ab3765d-fbbc-4651-bf49-70045f99d7c6/storage-initializer/1.log"
Oct 30 19:32:08.416347 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:08.416022    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q" event={"ID":"2ab3765d-fbbc-4651-bf49-70045f99d7c6","Type":"ContainerDied","Data":"34e350356d059dc06907e0180d44bdfa1b914b8972d2042d5a26b41966c25a85"}
Oct 30 19:32:08.416347 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:08.416051    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"
Oct 30 19:32:08.416347 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:08.416088    6064 scope.go:122] "RemoveContainer" containerID="eb91066d9f196cadbebd0d235a18e4e82b34c17321305817267cdcf6432d4609"
Oct 30 19:32:08.453811 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:08.453785    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"]
Oct 30 19:32:08.460293 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:08.460253    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-c83bbf5b66/isvc-sklearn-s3-tls-serving-fail-predictor-787486778-r256q"]
Oct 30 19:32:09.238632 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:09.238553    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" path="/var/lib/kubelet/pods/2ab3765d-fbbc-4651-bf49-70045f99d7c6/volumes"
Oct 30 19:32:23.060621 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:32:23.060580    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:32:41.570804 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:41.570678    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:32:41.584416 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:32:41.584395    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:32:53.059625 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:32:53.059586    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:33:23.059254 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:33:23.059173    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:33:53.062176 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:33:53.062126    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:33:53.587582 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.587545    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"]
Oct 30 19:33:53.588091 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.588068    6064 cpu_manager.go:414] "containerMap: removing container" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer"
Oct 30 19:33:53.588212 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.588095    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer"
Oct 30 19:33:53.588212 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.588115    6064 cpu_manager.go:414] "containerMap: removing container" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer"
Oct 30 19:33:53.588212 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.588142    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer"
Oct 30 19:33:53.588308 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.588225    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer"
Oct 30 19:33:53.588308 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.588239    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ab3765d-fbbc-4651-bf49-70045f99d7c6" containerName="storage-initializer"
Oct 30 19:33:53.591494 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.591476    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.595244 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.595223    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-lightgbm-v2-kserve-kube-rbac-proxy-sar-config\""
Oct 30 19:33:53.595575 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.595557    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:33:53.595575 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.595559    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:33:53.595799 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.595600    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-lightgbm-v2-kserve-predictor-serving-cert\""
Oct 30 19:33:53.595799 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.595786    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:33:53.598340 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.598153    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:33:53.598340 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.598159    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:33:53.604124 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.604104    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"]
Oct 30 19:33:53.712253 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.712224    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.712468 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.712279    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.712468 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.712398    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnk49\" (UniqueName: \"kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.712468 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.712444    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.712620 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.712543    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813070 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813038    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813290 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813100    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813290 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813153    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813290 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813203    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnk49\" (UniqueName: \"kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813290 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813234    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813534 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813503    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813882 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813857    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.813956 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.813900    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.815925 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.815905    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.825324 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.825299    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnk49\" (UniqueName: \"kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49\") pod \"isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") " pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:53.909243 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:53.909191    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:33:54.190277 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:54.190175    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"]
Oct 30 19:33:54.194628 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:33:54.194602    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ef1567_c674_40d5_9ee9_f71ebc39ec56.slice/crio-489f362b2fbfd2d76b463f0cce712a85123787c13c580b60dbec7ec47463bb5a WatchSource:0}: Error finding container 489f362b2fbfd2d76b463f0cce712a85123787c13c580b60dbec7ec47463bb5a: Status 404 returned error can't find the container with id 489f362b2fbfd2d76b463f0cce712a85123787c13c580b60dbec7ec47463bb5a
Oct 30 19:33:54.833829 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:54.833795    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerStarted","Data":"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"}
Oct 30 19:33:54.833999 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:54.833868    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerStarted","Data":"489f362b2fbfd2d76b463f0cce712a85123787c13c580b60dbec7ec47463bb5a"}
Oct 30 19:33:58.855647 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:58.855613    6064 generic.go:356] "Generic (PLEG): container finished" podID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerID="f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243" exitCode=0
Oct 30 19:33:58.856039 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:58.855685    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerDied","Data":"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"}
Oct 30 19:33:58.856907 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:33:58.856892    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:34:05.890035 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:05.890000    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerStarted","Data":"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"}
Oct 30 19:34:05.890420 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:05.890069    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerStarted","Data":"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"}
Oct 30 19:34:05.890420 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:05.890271    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:34:05.914510 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:05.914377    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" podStartSLOduration=2.519249878 podStartE2EDuration="12.914362865s" totalImagesPullingTime="6.36283672s" totalInitContainerRuntime="4.032276267s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:34:05.913623477 +0000 UTC m=+3384.791896297" watchObservedRunningTime="2026-10-30 19:34:05.914362865 +0000 UTC m=+3384.792635686"
Oct 30 19:34:06.894281 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:06.894236    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:34:06.895672 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:06.895615    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Oct 30 19:34:07.899119 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:07.899071    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Oct 30 19:34:12.903992 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:12.903960    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:34:12.904530 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:12.904497    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Oct 30 19:34:22.905393 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:22.905359    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:34:23.058674 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:34:23.058625    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:34:23.971266 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:23.971231    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"]
Oct 30 19:34:23.971716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:23.971541    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container" containerID="cri-o://fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5" gracePeriod=30
Oct 30 19:34:23.971716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:23.971571    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kube-rbac-proxy" containerID="cri-o://4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f" gracePeriod=30
Oct 30 19:34:24.609352 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.609330    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:34:24.659807 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.659781    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert\") pod \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") "
Oct 30 19:34:24.659949 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.659829    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config\") pod \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") "
Oct 30 19:34:24.659949 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.659850    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls\") pod \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") "
Oct 30 19:34:24.660091 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.659975    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location\") pod \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") "
Oct 30 19:34:24.660151 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.660085    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49\" (UniqueName: \"kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49\") pod \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\" (UID: \"e1ef1567-c674-40d5-9ee9-f71ebc39ec56\") "
Oct 30 19:34:24.660274 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.660246    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config" pod "e1ef1567-c674-40d5-9ee9-f71ebc39ec56" (UID: "e1ef1567-c674-40d5-9ee9-f71ebc39ec56"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:34:24.660274 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.660161    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert" pod "e1ef1567-c674-40d5-9ee9-f71ebc39ec56" (UID: "e1ef1567-c674-40d5-9ee9-f71ebc39ec56"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:34:24.660375 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.660305    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location" pod "e1ef1567-c674-40d5-9ee9-f71ebc39ec56" (UID: "e1ef1567-c674-40d5-9ee9-f71ebc39ec56"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:34:24.660375 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.660348    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:34:24.660375 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.660367    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:34:24.662055 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.662037    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls" pod "e1ef1567-c674-40d5-9ee9-f71ebc39ec56" (UID: "e1ef1567-c674-40d5-9ee9-f71ebc39ec56"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:34:24.662169 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.662146    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49" pod "e1ef1567-c674-40d5-9ee9-f71ebc39ec56" (UID: "e1ef1567-c674-40d5-9ee9-f71ebc39ec56"). InnerVolumeSpecName "kube-api-access-wnk49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:34:24.761100 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.761047    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:34:24.761100 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.761068    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:34:24.761100 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.761078    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnk49\" (UniqueName: \"kubernetes.io/projected/e1ef1567-c674-40d5-9ee9-f71ebc39ec56-kube-api-access-wnk49\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:34:24.969254 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969227    6064 generic.go:356] "Generic (PLEG): container finished" podID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerID="4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f" exitCode=0
Oct 30 19:34:24.969254 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969250    6064 generic.go:356] "Generic (PLEG): container finished" podID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerID="fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5" exitCode=0
Oct 30 19:34:24.969453 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969298    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"
Oct 30 19:34:24.969453 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969311    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerDied","Data":"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"}
Oct 30 19:34:24.969453 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969417    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerDied","Data":"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"}
Oct 30 19:34:24.969581 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969453    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4" event={"ID":"e1ef1567-c674-40d5-9ee9-f71ebc39ec56","Type":"ContainerDied","Data":"489f362b2fbfd2d76b463f0cce712a85123787c13c580b60dbec7ec47463bb5a"}
Oct 30 19:34:24.969581 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.969479    6064 scope.go:122] "RemoveContainer" containerID="4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"
Oct 30 19:34:24.978252 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.978086    6064 scope.go:122] "RemoveContainer" containerID="fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"
Oct 30 19:34:24.986830 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.986806    6064 scope.go:122] "RemoveContainer" containerID="f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"
Oct 30 19:34:24.990345 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.990324    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"]
Oct 30 19:34:24.994261 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.994239    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-lightgbm-v2-kserve-predictor-7fdd755554-4mst4"]
Oct 30 19:34:24.994713 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.994694    6064 scope.go:122] "RemoveContainer" containerID="4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"
Oct 30 19:34:24.994988 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:34:24.994969    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f\": container with ID starting with 4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f not found: ID does not exist" containerID="4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"
Oct 30 19:34:24.995037 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.994995    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"} err="failed to get container status \"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f\": rpc error: code = NotFound desc = could not find container \"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f\": container with ID starting with 4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f not found: ID does not exist"
Oct 30 19:34:24.995037 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995013    6064 scope.go:122] "RemoveContainer" containerID="fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"
Oct 30 19:34:24.995267 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:34:24.995250    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5\": container with ID starting with fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5 not found: ID does not exist" containerID="fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"
Oct 30 19:34:24.995309 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995273    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"} err="failed to get container status \"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5\": rpc error: code = NotFound desc = could not find container \"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5\": container with ID starting with fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5 not found: ID does not exist"
Oct 30 19:34:24.995309 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995286    6064 scope.go:122] "RemoveContainer" containerID="f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"
Oct 30 19:34:24.995551 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:34:24.995534    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243\": container with ID starting with f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243 not found: ID does not exist" containerID="f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"
Oct 30 19:34:24.995598 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995558    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"} err="failed to get container status \"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243\": rpc error: code = NotFound desc = could not find container \"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243\": container with ID starting with f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243 not found: ID does not exist"
Oct 30 19:34:24.995598 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995572    6064 scope.go:122] "RemoveContainer" containerID="4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"
Oct 30 19:34:24.995851 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995833    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f"} err="failed to get container status \"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f\": rpc error: code = NotFound desc = could not find container \"4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f\": container with ID starting with 4ad6b97262e59233eb4aef86c51849f3a9aa8e0502b69a65a704468d2d5b684f not found: ID does not exist"
Oct 30 19:34:24.995851 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.995851    6064 scope.go:122] "RemoveContainer" containerID="fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"
Oct 30 19:34:24.996066 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.996047    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5"} err="failed to get container status \"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5\": rpc error: code = NotFound desc = could not find container \"fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5\": container with ID starting with fe5490549af45e87fbd43144bcb22a8f56356db8bb809d037ef8d185a2399aa5 not found: ID does not exist"
Oct 30 19:34:24.996108 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.996067    6064 scope.go:122] "RemoveContainer" containerID="f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"
Oct 30 19:34:24.996315 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:24.996297    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243"} err="failed to get container status \"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243\": rpc error: code = NotFound desc = could not find container \"f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243\": container with ID starting with f92fb9e09707c1768590c6c6e978e19603d0bec723b2da3d9dedbc0df417b243 not found: ID does not exist"
Oct 30 19:34:25.238061 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:34:25.238036    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" path="/var/lib/kubelet/pods/e1ef1567-c674-40d5-9ee9-f71ebc39ec56/volumes"
Oct 30 19:34:53.060132 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:34:53.060043    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:35:21.122812 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.122779    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"]
Oct 30 19:35:21.123589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123324    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container"
Oct 30 19:35:21.123589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123456    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container"
Oct 30 19:35:21.123589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123479    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kube-rbac-proxy"
Oct 30 19:35:21.123589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123487    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kube-rbac-proxy"
Oct 30 19:35:21.123589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123501    6064 cpu_manager.go:414] "containerMap: removing container" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="storage-initializer"
Oct 30 19:35:21.123589 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123509    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="storage-initializer"
Oct 30 19:35:21.123982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123630    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kserve-container"
Oct 30 19:35:21.123982 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.123641    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="e1ef1567-c674-40d5-9ee9-f71ebc39ec56" containerName="kube-rbac-proxy"
Oct 30 19:35:21.127174 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.127153    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.130601 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130576    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-sklearn-mcp-kube-rbac-proxy-sar-config\""
Oct 30 19:35:21.130743 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130569    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"seaweedfs-s3-creds\""
Oct 30 19:35:21.130743 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130670    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"openshift-service-ca.crt\""
Oct 30 19:35:21.130880 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130739    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"odh-kserve-custom-ca-bundle\""
Oct 30 19:35:21.130880 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130739    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-3deaac58e4\"/\"kube-root-ca.crt\""
Oct 30 19:35:21.130880 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130847    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"isvc-sklearn-mcp-predictor-serving-cert\""
Oct 30 19:35:21.130981 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.130899    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-3deaac58e4\"/\"default-dockercfg-fr56d\""
Oct 30 19:35:21.141578 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.141553    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"]
Oct 30 19:35:21.283538 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.283506    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.283716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.283549    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.283716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.283673    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.283845 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.283717    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzrgd\" (UniqueName: \"kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.283845 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.283758    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.384636 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.384582    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.384636 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.384632    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.384822 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.384755    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzrgd\" (UniqueName: \"kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.384822 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.384789    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.384822 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.384814    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.385141 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.385117    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.385366 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.385350    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.385409 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.385352    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.387216 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.387195    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.396468 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.396449    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzrgd\" (UniqueName: \"kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd\") pod \"isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") " pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.450043 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.450019    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:21.731354 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:21.731198    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"]
Oct 30 19:35:21.735722 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:35:21.735693    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153155d9_af94_4047_9d97_ae361c2f2191.slice/crio-aee21331391020053c54efe7abf8676567b8fe4709f78a11f3af5638e513da2a WatchSource:0}: Error finding container aee21331391020053c54efe7abf8676567b8fe4709f78a11f3af5638e513da2a: Status 404 returned error can't find the container with id aee21331391020053c54efe7abf8676567b8fe4709f78a11f3af5638e513da2a
Oct 30 19:35:22.195593 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:22.195558    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerStarted","Data":"76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168"}
Oct 30 19:35:22.195993 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:22.195623    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerStarted","Data":"aee21331391020053c54efe7abf8676567b8fe4709f78a11f3af5638e513da2a"}
Oct 30 19:35:23.062499 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:35:23.062459    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:35:26.215721 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:26.215634    6064 generic.go:356] "Generic (PLEG): container finished" podID="153155d9-af94-4047-9d97-ae361c2f2191" containerID="76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168" exitCode=0
Oct 30 19:35:26.215721 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:26.215707    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerDied","Data":"76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168"}
Oct 30 19:35:27.223367 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:27.223332    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerStarted","Data":"dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2"}
Oct 30 19:35:30.238937 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:30.238911    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerStarted","Data":"7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc"}
Oct 30 19:35:30.239286 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:30.238962    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerStarted","Data":"6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922"}
Oct 30 19:35:30.239286 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:30.239061    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:30.239286 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:30.239110    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:30.239286 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:30.239136    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:30.263204 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:30.263158    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podStartSLOduration=1.340558549 podStartE2EDuration="9.263142061s" totalImagesPullingTime="3.761115332s" totalInitContainerRuntime="4.16146818s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:35:30.262069129 +0000 UTC m=+3469.140341950" watchObservedRunningTime="2026-10-30 19:35:30.263142061 +0000 UTC m=+3469.141414882"
Oct 30 19:35:36.248015 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:36.247984    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:35:53.059618 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:35:53.059575    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:35:56.249719 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:35:56.249682    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.47:8080/v1/models/isvc-sklearn-mcp\": dial tcp 10.134.0.47:8080: connect: connection refused"
Oct 30 19:36:01.451111 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:01.451066    6064 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.47:8080/v1/models/isvc-sklearn-mcp\": dial tcp 10.134.0.47:8080: connect: connection refused"
Oct 30 19:36:06.399726 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:06.399693    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:36:23.062988 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:36:23.062902    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:36:36.400459 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:36.400421    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:36:41.358702 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:41.358639    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"]
Oct 30 19:36:41.359095 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:41.359014    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container" containerID="cri-o://dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2" gracePeriod=30
Oct 30 19:36:41.359095 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:41.359056    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" containerID="cri-o://7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc" gracePeriod=30
Oct 30 19:36:41.359615 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:41.359075    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-agent" containerID="cri-o://6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922" gracePeriod=30
Oct 30 19:36:41.512815 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:41.512789    6064 generic.go:356] "Generic (PLEG): container finished" podID="153155d9-af94-4047-9d97-ae361c2f2191" containerID="7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc" exitCode=0
Oct 30 19:36:41.512920 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:41.512832    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerDied","Data":"7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc"}
Oct 30 19:36:43.523049 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:43.522987    6064 generic.go:356] "Generic (PLEG): container finished" podID="153155d9-af94-4047-9d97-ae361c2f2191" containerID="dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2" exitCode=0
Oct 30 19:36:43.523049 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:43.523045    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerDied","Data":"dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2"}
Oct 30 19:36:46.243579 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:46.243533    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.47:8643/healthz\": dial tcp 10.134.0.47:8643: connect: connection refused"
Oct 30 19:36:46.248849 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:46.248822    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.47:8080/v1/models/isvc-sklearn-mcp\": dial tcp 10.134.0.47:8080: connect: connection refused"
Oct 30 19:36:51.243832 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:51.243788    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.47:8643/healthz\": dial tcp 10.134.0.47:8643: connect: connection refused"
Oct 30 19:36:53.058257 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:36:53.058219    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:36:56.243167 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:56.243118    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.47:8643/healthz\": dial tcp 10.134.0.47:8643: connect: connection refused"
Oct 30 19:36:56.243705 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:56.243280    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:36:56.248940 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:36:56.248909    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.47:8080/v1/models/isvc-sklearn-mcp\": dial tcp 10.134.0.47:8080: connect: connection refused"
Oct 30 19:37:01.243806 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:01.243771    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.47:8643/healthz\": dial tcp 10.134.0.47:8643: connect: connection refused"
Oct 30 19:37:06.243904 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:06.243850    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.47:8643/healthz\": dial tcp 10.134.0.47:8643: connect: connection refused"
Oct 30 19:37:06.248666 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:06.248623    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container" probeResult="failure" output="Get \"http://10.134.0.47:8080/v1/models/isvc-sklearn-mcp\": dial tcp 10.134.0.47:8080: connect: connection refused"
Oct 30 19:37:06.248778 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:06.248762    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:37:11.243410 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.243362    6064 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.47:8643/healthz\": dial tcp 10.134.0.47:8643: connect: connection refused"
Oct 30 19:37:11.502005 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.501950    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:37:11.614230 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614201    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location\") pod \"153155d9-af94-4047-9d97-ae361c2f2191\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") "
Oct 30 19:37:11.614376 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614239    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config\") pod \"153155d9-af94-4047-9d97-ae361c2f2191\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") "
Oct 30 19:37:11.614376 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614282    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert\") pod \"153155d9-af94-4047-9d97-ae361c2f2191\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") "
Oct 30 19:37:11.614376 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614327    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd\" (UniqueName: \"kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd\") pod \"153155d9-af94-4047-9d97-ae361c2f2191\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") "
Oct 30 19:37:11.614376 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614359    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls\" (UniqueName: \"kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls\") pod \"153155d9-af94-4047-9d97-ae361c2f2191\" (UID: \"153155d9-af94-4047-9d97-ae361c2f2191\") "
Oct 30 19:37:11.614610 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614509    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location" pod "153155d9-af94-4047-9d97-ae361c2f2191" (UID: "153155d9-af94-4047-9d97-ae361c2f2191"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:37:11.614648 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614630    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config" pod "153155d9-af94-4047-9d97-ae361c2f2191" (UID: "153155d9-af94-4047-9d97-ae361c2f2191"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:37:11.614732 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.614708    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert" pod "153155d9-af94-4047-9d97-ae361c2f2191" (UID: "153155d9-af94-4047-9d97-ae361c2f2191"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:37:11.616611 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.616586    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls" pod "153155d9-af94-4047-9d97-ae361c2f2191" (UID: "153155d9-af94-4047-9d97-ae361c2f2191"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:37:11.616797 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.616777    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd" pod "153155d9-af94-4047-9d97-ae361c2f2191" (UID: "153155d9-af94-4047-9d97-ae361c2f2191"). InnerVolumeSpecName "kube-api-access-gzrgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:37:11.636087 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.636062    6064 generic.go:356] "Generic (PLEG): container finished" podID="153155d9-af94-4047-9d97-ae361c2f2191" containerID="6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922" exitCode=137
Oct 30 19:37:11.636194 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.636119    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerDied","Data":"6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922"}
Oct 30 19:37:11.636194 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.636130    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"
Oct 30 19:37:11.636194 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.636173    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68" event={"ID":"153155d9-af94-4047-9d97-ae361c2f2191","Type":"ContainerDied","Data":"aee21331391020053c54efe7abf8676567b8fe4709f78a11f3af5638e513da2a"}
Oct 30 19:37:11.636360 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.636203    6064 scope.go:122] "RemoveContainer" containerID="7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc"
Oct 30 19:37:11.645450 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.645263    6064 scope.go:122] "RemoveContainer" containerID="6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922"
Oct 30 19:37:11.652716 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.652698    6064 scope.go:122] "RemoveContainer" containerID="dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2"
Oct 30 19:37:11.660413 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.660399    6064 scope.go:122] "RemoveContainer" containerID="76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168"
Oct 30 19:37:11.663898 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.663873    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"]
Oct 30 19:37:11.666607 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.666586    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-3deaac58e4/isvc-sklearn-mcp-predictor-6f87f7c6bf-f8b68"]
Oct 30 19:37:11.669033 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669018    6064 scope.go:122] "RemoveContainer" containerID="7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc"
Oct 30 19:37:11.669293 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:37:11.669272    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc\": container with ID starting with 7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc not found: ID does not exist" containerID="7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc"
Oct 30 19:37:11.669345 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669302    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc"} err="failed to get container status \"7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc\": rpc error: code = NotFound desc = could not find container \"7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc\": container with ID starting with 7e376fa93b53fadcddc39149a878aae8a36025d454cbbde292795870d3ab48bc not found: ID does not exist"
Oct 30 19:37:11.669345 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669318    6064 scope.go:122] "RemoveContainer" containerID="6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922"
Oct 30 19:37:11.669520 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:37:11.669502    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922\": container with ID starting with 6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922 not found: ID does not exist" containerID="6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922"
Oct 30 19:37:11.669585 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669533    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922"} err="failed to get container status \"6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922\": rpc error: code = NotFound desc = could not find container \"6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922\": container with ID starting with 6ceabbc4aa1bd45bae685b177a256920d626e8601384d03d4a9c183c21c6e922 not found: ID does not exist"
Oct 30 19:37:11.669585 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669556    6064 scope.go:122] "RemoveContainer" containerID="dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2"
Oct 30 19:37:11.669806 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:37:11.669790    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2\": container with ID starting with dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2 not found: ID does not exist" containerID="dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2"
Oct 30 19:37:11.669876 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669809    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2"} err="failed to get container status \"dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2\": rpc error: code = NotFound desc = could not find container \"dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2\": container with ID starting with dfa2972ca456a690d982eb57430a21736bb1b19cdffcd0b5a826aa2acaa939e2 not found: ID does not exist"
Oct 30 19:37:11.669876 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.669821    6064 scope.go:122] "RemoveContainer" containerID="76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168"
Oct 30 19:37:11.670043 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:37:11.670026    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168\": container with ID starting with 76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168 not found: ID does not exist" containerID="76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168"
Oct 30 19:37:11.670097 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.670051    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168"} err="failed to get container status \"76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168\": rpc error: code = NotFound desc = could not find container \"76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168\": container with ID starting with 76374e2fb4a627e66b39f6da211632f784a8fc6979686a213d87f173254df168 not found: ID does not exist"
Oct 30 19:37:11.715785 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.715758    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzrgd\" (UniqueName: \"kubernetes.io/projected/153155d9-af94-4047-9d97-ae361c2f2191-kube-api-access-gzrgd\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:37:11.715785 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.715782    6064 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/153155d9-af94-4047-9d97-ae361c2f2191-proxy-tls\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:37:11.715906 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.715799    6064 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/153155d9-af94-4047-9d97-ae361c2f2191-kserve-provision-location\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:37:11.715906 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.715811    6064 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:37:11.715906 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:11.715825    6064 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/153155d9-af94-4047-9d97-ae361c2f2191-cabundle-cert\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:37:13.237382 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:13.237352    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="153155d9-af94-4047-9d97-ae361c2f2191" path="/var/lib/kubelet/pods/153155d9-af94-4047-9d97-ae361c2f2191/volumes"
Oct 30 19:37:23.060951 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:37:23.060909    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:37:41.603525 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:41.603495    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:37:41.613901 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:37:41.613881    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7958_85212acf-4a7d-4d5b-b1cf-4a0e5ac7f0d2/ovn-acl-logging/0.log"
Oct 30 19:37:53.059528 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:37:53.059451    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:38:23.059056 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:38:23.059022    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:38:53.058196 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:38:53.058156    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:39:04.886772 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.886736    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-krz47/must-gather-t5458"]
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887038    6064 cpu_manager.go:414] "containerMap: removing container" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-agent"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887049    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-agent"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887062    6064 cpu_manager.go:414] "containerMap: removing container" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="storage-initializer"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887068    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="storage-initializer"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887076    6064 cpu_manager.go:414] "containerMap: removing container" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887080    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887086    6064 cpu_manager.go:414] "containerMap: removing container" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887091    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887160    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-agent"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887167    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kserve-container"
Oct 30 19:39:04.887258 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.887173    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="153155d9-af94-4047-9d97-ae361c2f2191" containerName="kube-rbac-proxy"
Oct 30 19:39:04.890092 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.890077    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:04.900955 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.900937    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-krz47\"/\"openshift-service-ca.crt\""
Oct 30 19:39:04.904797 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.904777    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-krz47/must-gather-t5458"]
Oct 30 19:39:04.906932 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:04.906911    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-krz47\"/\"default-dockercfg-2m54l\""
Oct 30 19:39:05.001505 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.001478    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-krz47\"/\"kube-root-ca.crt\""
Oct 30 19:39:05.054889 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.054854    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output\") pod \"must-gather-t5458\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") " pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.055007 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.054935    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7bsc\" (UniqueName: \"kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc\") pod \"must-gather-t5458\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") " pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.155607 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.155539    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output\") pod \"must-gather-t5458\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") " pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.155747 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.155603    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7bsc\" (UniqueName: \"kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc\") pod \"must-gather-t5458\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") " pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.155891 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.155865    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output\") pod \"must-gather-t5458\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") " pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.168050 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.168022    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7bsc\" (UniqueName: \"kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc\") pod \"must-gather-t5458\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") " pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.213214 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.213189    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:05.487348 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.487269    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-krz47/must-gather-t5458"]
Oct 30 19:39:05.491384 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:39:05.491359    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcca8f1bc_b9fd_48ad_a5aa_cc1a8b061d48.slice/crio-222065c7bf809a27c6f5e2b342930d60215025a80ea3e741c57808479bbf4f5f WatchSource:0}: Error finding container 222065c7bf809a27c6f5e2b342930d60215025a80ea3e741c57808479bbf4f5f: Status 404 returned error can't find the container with id 222065c7bf809a27c6f5e2b342930d60215025a80ea3e741c57808479bbf4f5f
Oct 30 19:39:05.493226 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:05.493207    6064 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:39:06.085361 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:06.085327    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-krz47/must-gather-t5458" event={"ID":"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48","Type":"ContainerStarted","Data":"222065c7bf809a27c6f5e2b342930d60215025a80ea3e741c57808479bbf4f5f"}
Oct 30 19:39:12.112476 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:12.112439    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-krz47/must-gather-t5458" event={"ID":"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48","Type":"ContainerStarted","Data":"b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e"}
Oct 30 19:39:12.113098 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:12.112489    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-krz47/must-gather-t5458" event={"ID":"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48","Type":"ContainerStarted","Data":"cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"}
Oct 30 19:39:12.132137 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:12.132066    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-krz47/must-gather-t5458" podStartSLOduration=1.868187674 podStartE2EDuration="8.132048341s" totalImagesPullingTime="6.263860667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:12.13098961 +0000 UTC m=+3691.009262430" watchObservedRunningTime="2026-10-30 19:39:12.132048341 +0000 UTC m=+3691.010321155"
Oct 30 19:39:23.063840 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:23.063757    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:39:33.203601 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:33.203566    6064 generic.go:356] "Generic (PLEG): container finished" podID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerID="cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d" exitCode=0
Oct 30 19:39:33.204104 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:33.203643    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-krz47/must-gather-t5458" event={"ID":"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48","Type":"ContainerDied","Data":"cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"}
Oct 30 19:39:33.204104 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:33.204000    6064 scope.go:122] "RemoveContainer" containerID="cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"
Oct 30 19:39:33.268616 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:33.268564    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-krz47_must-gather-t5458_cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48/gather/0.log"
Oct 30 19:39:37.636535 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:37.636501    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mr8gw_72812209-4f7e-4e07-8b12-e2271ad4470f/global-pull-secret-syncer/0.log"
Oct 30 19:39:38.088499 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:38.088478    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kj7ts_33d580e1-86c1-41a5-b0ed-3c846111d6b4/konnectivity-agent/0.log"
Oct 30 19:39:38.309039 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:38.309010    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-34.us-east-2.compute.internal_5556c3ea4229dba8b9cd7852950cab95/haproxy/0.log"
Oct 30 19:39:38.810461 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:38.810432    6064 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-krz47/must-gather-t5458"]
Oct 30 19:39:38.810945 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:38.810789    6064 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-must-gather-krz47/must-gather-t5458" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="copy" containerID="cri-o://b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e" gracePeriod=2
Oct 30 19:39:38.814908 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:38.814874    6064 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-krz47/must-gather-t5458"]
Oct 30 19:39:39.037201 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.037178    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-krz47_must-gather-t5458_cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48/copy/0.log"
Oct 30 19:39:39.039647 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.039630    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:39.041611 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:39.041592    6064 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-t5458\" is forbidden: User \"system:node:ip-10-0-135-34.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-krz47\": no relationship found between node 'ip-10-0-135-34.us-east-2.compute.internal' and this object" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:39.148731 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.148713    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output\") pod \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") "
Oct 30 19:39:39.148838 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.148785    6064 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc\" (UniqueName: \"kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc\") pod \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\" (UID: \"cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48\") "
Oct 30 19:39:39.150076 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.150044    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output" pod "cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" (UID: "cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:39.151018 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.150997    6064 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc" pod "cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" (UID: "cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48"). InnerVolumeSpecName "kube-api-access-r7bsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:39.228862 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.228838    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-krz47_must-gather-t5458_cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48/copy/0.log"
Oct 30 19:39:39.229218 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.229198    6064 generic.go:356] "Generic (PLEG): container finished" podID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerID="b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e" exitCode=143
Oct 30 19:39:39.229323 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.229250    6064 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:39.229323 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.229290    6064 scope.go:122] "RemoveContainer" containerID="b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e"
Oct 30 19:39:39.231339 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:39.231313    6064 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-t5458\" is forbidden: User \"system:node:ip-10-0-135-34.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-krz47\": no relationship found between node 'ip-10-0-135-34.us-east-2.compute.internal' and this object" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:39.238073 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.238051    6064 scope.go:122] "RemoveContainer" containerID="cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"
Oct 30 19:39:39.238256 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.238238    6064 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" path="/var/lib/kubelet/pods/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48/volumes"
Oct 30 19:39:39.239498 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:39.239472    6064 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-t5458\" is forbidden: User \"system:node:ip-10-0-135-34.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-krz47\": no relationship found between node 'ip-10-0-135-34.us-east-2.compute.internal' and this object" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" pod="openshift-must-gather-krz47/must-gather-t5458"
Oct 30 19:39:39.249779 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.249759    6064 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7bsc\" (UniqueName: \"kubernetes.io/projected/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-kube-api-access-r7bsc\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:39.249779 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.249779    6064 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48-must-gather-output\") on node \"ip-10-0-135-34.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:39.250624 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.250612    6064 scope.go:122] "RemoveContainer" containerID="b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e"
Oct 30 19:39:39.250882 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:39.250865    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e\": container with ID starting with b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e not found: ID does not exist" containerID="b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e"
Oct 30 19:39:39.250945 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.250887    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e"} err="failed to get container status \"b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e\": rpc error: code = NotFound desc = could not find container \"b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e\": container with ID starting with b6c766962d222c24c7602ecf80bbdea05656e629904b788d1736d6af14a4e81e not found: ID does not exist"
Oct 30 19:39:39.250945 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.250901    6064 scope.go:122] "RemoveContainer" containerID="cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"
Oct 30 19:39:39.251138 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:39.251122    6064 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d\": container with ID starting with cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d not found: ID does not exist" containerID="cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"
Oct 30 19:39:39.251179 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:39.251141    6064 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d"} err="failed to get container status \"cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d\": rpc error: code = NotFound desc = could not find container \"cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d\": container with ID starting with cba88781a01e37c9ae8ee6c42e569ebc5a58b4a1f8115dce32253d39154ad39d not found: ID does not exist"
Oct 30 19:39:43.545099 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.545067    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/alertmanager/0.log"
Oct 30 19:39:43.586054 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.586025    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/config-reloader/0.log"
Oct 30 19:39:43.620418 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.620391    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/kube-rbac-proxy-web/0.log"
Oct 30 19:39:43.654698 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.654673    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/kube-rbac-proxy/0.log"
Oct 30 19:39:43.688851 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.688814    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/kube-rbac-proxy-metric/0.log"
Oct 30 19:39:43.727338 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.727318    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/prom-label-proxy/0.log"
Oct 30 19:39:43.767203 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.767182    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7f3dfb12-8564-4e04-988d-425c9eb79996/init-config-reloader/0.log"
Oct 30 19:39:43.885011 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.884987    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-krztj_ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/kube-state-metrics/0.log"
Oct 30 19:39:43.929555 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.929525    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-krztj_ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/kube-rbac-proxy-main/0.log"
Oct 30 19:39:43.963941 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:43.963921    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-krztj_ab6242e1-e200-4ca0-be72-7eb7a46e8ee0/kube-rbac-proxy-self/0.log"
Oct 30 19:39:44.020304 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.020288    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64bc79665d-fthpb_07aedb61-c8c3-48b2-9a23-98fbc418c394/metrics-server/0.log"
Oct 30 19:39:44.344370 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.344340    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjg84_2bb1395d-e068-4d07-a218-971ffb972271/node-exporter/0.log"
Oct 30 19:39:44.382039 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.381991    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjg84_2bb1395d-e068-4d07-a218-971ffb972271/kube-rbac-proxy/0.log"
Oct 30 19:39:44.416605 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.416587    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjg84_2bb1395d-e068-4d07-a218-971ffb972271/init-textfile/0.log"
Oct 30 19:39:44.454638 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.454605    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-kpvwf_9a96c523-b3c5-49e5-b785-d6bb59ac17ef/kube-rbac-proxy-main/0.log"
Oct 30 19:39:44.500544 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.500521    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-kpvwf_9a96c523-b3c5-49e5-b785-d6bb59ac17ef/kube-rbac-proxy-self/0.log"
Oct 30 19:39:44.538049 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.537905    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-kpvwf_9a96c523-b3c5-49e5-b785-d6bb59ac17ef/openshift-state-metrics/0.log"
Oct 30 19:39:44.595135 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.595078    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/prometheus/0.log"
Oct 30 19:39:44.622341 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.622321    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/config-reloader/0.log"
Oct 30 19:39:44.660067 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.660046    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/thanos-sidecar/0.log"
Oct 30 19:39:44.693695 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.693677    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/kube-rbac-proxy-web/0.log"
Oct 30 19:39:44.729193 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.729174    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/kube-rbac-proxy/0.log"
Oct 30 19:39:44.763829 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.763805    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/kube-rbac-proxy-thanos/0.log"
Oct 30 19:39:44.808719 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.808695    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_736b99f4-9e5c-4934-9d55-b18c7e42d58b/init-config-reloader/0.log"
Oct 30 19:39:44.861908 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.861835    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-drcmf_3201fe70-508e-4bba-8ad4-79a9f33a7df2/prometheus-operator/0.log"
Oct 30 19:39:44.890602 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:44.890567    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-drcmf_3201fe70-508e-4bba-8ad4-79a9f33a7df2/kube-rbac-proxy/0.log"
Oct 30 19:39:45.082968 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.082935    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d5bb77c5-jvkpq_7150c1a0-ddc4-458e-939b-25e28b3a0496/thanos-query/0.log"
Oct 30 19:39:45.119181 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.119111    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d5bb77c5-jvkpq_7150c1a0-ddc4-458e-939b-25e28b3a0496/kube-rbac-proxy-web/0.log"
Oct 30 19:39:45.158118 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.158097    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d5bb77c5-jvkpq_7150c1a0-ddc4-458e-939b-25e28b3a0496/kube-rbac-proxy/0.log"
Oct 30 19:39:45.191085 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.191062    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d5bb77c5-jvkpq_7150c1a0-ddc4-458e-939b-25e28b3a0496/prom-label-proxy/0.log"
Oct 30 19:39:45.234947 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.234923    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d5bb77c5-jvkpq_7150c1a0-ddc4-458e-939b-25e28b3a0496/kube-rbac-proxy-rules/0.log"
Oct 30 19:39:45.269166 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.269149    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55d5bb77c5-jvkpq_7150c1a0-ddc4-458e-939b-25e28b3a0496/kube-rbac-proxy-metrics/0.log"
Oct 30 19:39:45.896953 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.896916    6064 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"]
Oct 30 19:39:45.897321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.897215    6064 cpu_manager.go:414] "containerMap: removing container" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="copy"
Oct 30 19:39:45.897321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.897225    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="copy"
Oct 30 19:39:45.897321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.897251    6064 cpu_manager.go:414] "containerMap: removing container" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="gather"
Oct 30 19:39:45.897321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.897256    6064 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="gather"
Oct 30 19:39:45.897321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.897304    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="gather"
Oct 30 19:39:45.897321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.897316    6064 memory_manager.go:365] "RemoveStaleState removing state" podUID="cca8f1bc-b9fd-48ad-a5aa-cc1a8b061d48" containerName="copy"
Oct 30 19:39:45.902783 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.902762    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:45.909248 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.909202    6064 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zdcz8\"/\"default-dockercfg-rst5l\""
Oct 30 19:39:45.913498 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.913478    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zdcz8\"/\"kube-root-ca.crt\""
Oct 30 19:39:45.917695 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.917537    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"]
Oct 30 19:39:45.998077 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.998046    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-lib-modules\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:45.998077 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.998076    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-podres\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:45.998248 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.998166    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-sys\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:45.998248 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.998237    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtb4m\" (UniqueName: \"kubernetes.io/projected/7599eef7-9c55-4dcf-ac82-767c71d13c5e-kube-api-access-dtb4m\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:45.998321 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:45.998265    6064 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-proc\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.000383 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.000368    6064 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zdcz8\"/\"openshift-service-ca.crt\""
Oct 30 19:39:46.099295 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099272    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-lib-modules\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099396 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099297    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-podres\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099396 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099330    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-sys\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099396 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099348    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtb4m\" (UniqueName: \"kubernetes.io/projected/7599eef7-9c55-4dcf-ac82-767c71d13c5e-kube-api-access-dtb4m\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099396 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099370    6064 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-proc\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099547 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099413    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-lib-modules\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099547 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099437    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-proc\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099547 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099413    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-sys\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.099547 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.099413    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7599eef7-9c55-4dcf-ac82-767c71d13c5e-podres\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.111350 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.111330    6064 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtb4m\" (UniqueName: \"kubernetes.io/projected/7599eef7-9c55-4dcf-ac82-767c71d13c5e-kube-api-access-dtb4m\") pod \"perf-node-gather-daemonset-j8zr8\" (UID: \"7599eef7-9c55-4dcf-ac82-767c71d13c5e\") " pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.215184 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.215135    6064 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:46.495493 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:46.495427    6064 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"]
Oct 30 19:39:46.500537 ip-10-0-135-34 kubenswrapper[6064]: W1030 19:39:46.500514    6064 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7599eef7_9c55_4dcf_ac82_767c71d13c5e.slice/crio-bac1d6a815b0934dc331b2b73bc6094e6744d762d8ecc960ea23ce9401d0910d WatchSource:0}: Error finding container bac1d6a815b0934dc331b2b73bc6094e6744d762d8ecc960ea23ce9401d0910d: Status 404 returned error can't find the container with id bac1d6a815b0934dc331b2b73bc6094e6744d762d8ecc960ea23ce9401d0910d
Oct 30 19:39:47.263660 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:47.263630    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8" event={"ID":"7599eef7-9c55-4dcf-ac82-767c71d13c5e","Type":"ContainerStarted","Data":"2721ad725fdf5dd106c1e79aad67656e874f1b5d0a1ec6754425fb764060a0d7"}
Oct 30 19:39:47.264111 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:47.263687    6064 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8" event={"ID":"7599eef7-9c55-4dcf-ac82-767c71d13c5e","Type":"ContainerStarted","Data":"bac1d6a815b0934dc331b2b73bc6094e6744d762d8ecc960ea23ce9401d0910d"}
Oct 30 19:39:47.264111 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:47.263715    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:47.289270 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:47.289057    6064 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8" podStartSLOduration=2.289043161 podStartE2EDuration="2.289043161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:47.287336766 +0000 UTC m=+3726.165609586" watchObservedRunningTime="2026-10-30 19:39:47.289043161 +0000 UTC m=+3726.167315983"
Oct 30 19:39:47.534588 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:47.534507    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66d666d5dc-g8p29_92d8acc0-9d93-49ae-ab67-10e3710e35da/console/0.log"
Oct 30 19:39:49.428096 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:49.428062    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wphqb_134db473-2a39-4577-861a-09778c502691/dns/0.log"
Oct 30 19:39:49.461806 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:49.461783    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wphqb_134db473-2a39-4577-861a-09778c502691/kube-rbac-proxy/0.log"
Oct 30 19:39:49.500028 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:49.500002    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-778wz_ad566b69-5edc-4e9b-9e58-55e8cc1f1ec2/dns-node-resolver/0.log"
Oct 30 19:39:50.205202 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:50.205168    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xmbq_4e6fda66-4524-4933-b497-2056bb7ed874/node-ca/0.log"
Oct 30 19:39:51.560119 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:51.560073    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6dqls_b74b9bd1-8acf-4839-9c82-84baf2e3b636/serve-healthcheck-canary/0.log"
Oct 30 19:39:52.169522 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:52.169492    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kkds7_f29e62d4-6063-432c-a721-e817f002b5a2/kube-rbac-proxy/0.log"
Oct 30 19:39:52.203021 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:52.202991    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kkds7_f29e62d4-6063-432c-a721-e817f002b5a2/exporter/0.log"
Oct 30 19:39:52.238565 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:52.238540    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kkds7_f29e62d4-6063-432c-a721-e817f002b5a2/extractor/0.log"
Oct 30 19:39:53.059689 ip-10-0-135-34 kubenswrapper[6064]: E1030 19:39:53.059630    6064 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kkds7" containerName="extractor"
Oct 30 19:39:53.277113 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:53.277090    6064 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zdcz8/perf-node-gather-daemonset-j8zr8"
Oct 30 19:39:56.361613 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:56.361575    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-s6t62_8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49/s3-init/0.log"
Oct 30 19:39:56.388863 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:56.388833    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-s6t62_8093b71f-ec0d-4e3e-9e42-c28ce0cd3a49/download-hf-model/0.log"
Oct 30 19:39:56.436866 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:56.436841    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-h28j5_044d187c-e0b6-4155-a23e-532b962c0b92/s3-tls-init-custom/0.log"
Oct 30 19:39:56.464521 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:56.464497    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-h28j5_044d187c-e0b6-4155-a23e-532b962c0b92/download-hf-model/0.log"
Oct 30 19:39:56.513695 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:56.513637    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-lcn5z_df9e467f-8be5-48b2-be77-bab481d41e80/s3-tls-init-serving/0.log"
Oct 30 19:39:56.546009 ip-10-0-135-34 kubenswrapper[6064]: I1030 19:39:56.545981    6064 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-lcn5z_df9e467f-8be5-48b2-be77-bab481d41e80/download-hf-model/0.log"